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JAMES FOWLER TOCHER 


James Fowler Tocher (1864-1945), chemist, ethnologist, biometrician, agriculturist and 
man of affairs, began adult life by opening a chemist’s business in Peterhead more than sixty 
years ago. Even sixty years ago, scientific chemistry was not restricted to professors or even 
analysts, and certainly proprietors of businesses sometimes made money. The Southron, 
however, unduly influenced by jokes about Aberdonians—most of which are based on the 
principle, lucus a non lucendo—would not think Peterhead a promising venue either for 
scientific research or earning a competence. In fact, the business was a financial success; 
Tocher disposed of it in 1912 and when he passed to the analytical branch of professional 
chemistry, he had already made a name among chemists and biometricians (he was President 
of the Pharmaceutical Society of Great Britain in 1908). 

Like several other men who have done important scientific work Tocher owed a good deal 
to a local society, the Buchan Field Club. In the south, although the name Fie!d Club is 
used, e.g. the Essex Field Club, Natural History Society is perhaps a commoner designation 
and can include all the descriptive sciences. It is quite possible that these societies are 
educationally almost as valuable as classes in technical colleges even now; sixty years ago 
they were invaluable. The Buchan Field Club published transactions; in these appeared 
Tocher’s earliest statistical papers, the very first in 1895. 

They were concerned with the ethnology of Buchan and form the basis of the wider 
studies with which his name is usually associated. Among the earlier papers is one, written 
jointly with a frequent collaborator, Mr, afterwards Prof., James Gray, on the ‘Frequency 
and Pigmentation Value of Surnames in East Aberdeenshire’. 

More than ninety years ago, William Farr wrote an essay on the statistics of surnames 
which appeared in the Sixteenth Annual Report of the Registrar General and may have been 
read by Tocher because it is reprinted in the memorial volume edited by Noel Humphreys 
which preserves some, but by no means all, of the delightful essays by an old master. Farr 
used the registers of births and deaths and found in a sample of 275,405 names 32,818 
different surnames or 11-9°% different surnames. In Wales the proportion was much 
smaller. ‘The name of John Jones is a perpetual incognito in Wales, and being proclaimed 
at the cross of a market town would indicate no one in particular.’ Farr touched on the local 
distributions and asked such questions as whether the present predominance of the Smiths 
were due to the original numerical strength of that great family, or ‘to some special 
circumstances acting upon the ordinary laws of increase, owing to which the descendants of 
the hammer-men have multiplied at a greater rate than the bearers of any other name?’ 
Did the progeny, he asked, of the tawny Browns increase faster than that of the fair- 
complexioned Whites? 

Tocher interested himself in such problems. The data of the investigation of Gray & 
Tocher (printed in 1902) were pigmentation records of 14,561 school-children in East 
Aberdeenshire. Thése 14,561 children had 751 surnames, 5-2 %. A smaller proportion than 
in Farr’s data, as one might expect, since in a school population there would be many more 
brothers and sisters than in the birth and death registers for two quarters. In East Aberdeen- 
shire, Smith, scoring 203, was easily beaten by Milne with 267; third came Taylor, which is 
fourth on Farr’s list for England and Wales. Gray & Tocher worked out the mean and 
standard deviation in pigmentation units of the children with different surnames. “The 
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blondest surname in our list is Pirie....Next to Pirie comes the surname Wallace. This 
points to the conclusion that the Wallace sept sprang from ancestors with a decided blonde 
tendency.’ 

The use of the standard deviation in this paper, as well as an allusion to Karl Pearson’s 
work on assortative mating, show that either Gray or Tocher or both were already readers 
of K.P. At what date Tocher made the personal acquaintance with Karl Pearson, which 
ripened into a warm friendship, I do not know. Five years later, in 1907,* Tocher’s first 
full-scale biometric memoir appeared in this Journal (Vol. 5, pp. 298-35v). The original data 
are printed as an appendix to the volume. It is careful biometric study of the stature, 
pigmentation, and craniometry of inmates of Mental Homes in Scotland. In 1908 (Vol. 6, 
pp. 129-235, Appendix 1-63) is an equally careful study of the pigmentation of school- 
children in Scotland. These researches were financed by the Henderson Trust who published 
in book form (Oliver & Boyd, 1924) a summary by Tocher of the results recorded in the 
earlier papers together with those of later anthropometric observations on samples of the 
civil populations of Aberdeenshire, Banffshire and Kincardineshire and on soldiers. of 
Scottish nationality. 

The use of superlatives is not a method of science—there is no greatest ‘scientist’—but, 
whether any anthropometric survey of another part of the British Isles so far undertaken 
can take precedence over the voluntary work of Tocher supported financially not by the state 
but by a private trust, is a question which may fairly be asked. I think the answer is ‘no’. 
Tocher’s analysis followed the lines of teaching so many of us older people look back upon 
with gratitude. It may well be that, since his time, the technique of craniometry has been 
extended and genetic research has modified some of the perhaps rather naive theories of 
inheritance popular a generation ago. But Tocher’s work remains of fundamental 
importance; it is a pity his example did not inspire Englishmen to extend his study of 
mental hospital populations. 

In 1925 (Biometrika, Vol. 17, pp. 142-58) R. Greenwood, C. M. Thompson & H. M. Woods 
published a memoir on heights and weights of patients and there are scattered through the 
literature other statistical papers, but not, I think, any large-scale investigation. But the 
mind-body relation still interests us all. Our remote predecessors thought there was 
a corporeal basis of the sanguine, melancholic, choleric and phlegmatic temperaments; 
psychologists and pathologists of to-day reject the bases imagined by our ancestors, but still 
search for a basis. Most people know that pulmonary tuberculosis takes a heavy toll in 
mental hospitals and perhaps dismiss the subject with some vague remark about the 

‘unfit’ or, alternatively, remember that the old physicians thought that grief or emotional 
shock was a factor predisposing to consumption. There seems to be no doubt that a particular 
form of mental disorder, dementia praecox, is particularly associated with tuberculosis, so 
intimately that one writer has maintained that dementia praecox and pulmonary tuberculosis 
can, in a sense, be regarded as modifications or expressions of a common defect or diathesis. 
All this is, however, the merest speculation without a biometric study. Obviously to take 
the heights and weights of patients in institutions would only be a beginning. Tocher did 
not classify his data under diagnosis, perhaps he could not have done so usefully because, 


* [During the summer of 1906, Tocher came south to Danby, in the Yorkshire moors, where K.P. was 
spending his vacation and the fina] arrangements for the publication of this memoir were no doubt then 
discussed. Tocher was also a friend of W. R. Macdonell whom he succeeded, at a rather later date, as 
part time lecturer in Statistics at the University of Aberdeen. Ed.] 
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although 4436 males and 3951 females sound large numbers, when they are subdivided into 
age- and diagnosis-groups, the classes would grow small. The records of the mental hospitals 
of Great Britain in the forty years since Tocher did his work would suffice. But there has 
not been an English Tocher. 

In his later years, Tocher’s deserved reputation led to official or semi-official appeals for 
his help in work involving statistical analysis. He was very active in the study of milk 
production; in tackling such problems his chemical training was of great value. A matter of 
obvious importance is whether poor yield is due to nature or nurture or to both. Tocher was 
of opinion that both factors were involved but that ‘the solution to the problem of deficient 
milk must be the careful selection of cows with good milk records and a good milking 
pedigree’ (see Stewart & Tocher, J. Dairy Res., January 1936). Tocher did not forget, as 
some academic writers did, the importance of vicious circles; those who farm with insufficient 
capital cannot afford to buy pedigree stock and cannot afford to feed adequately what stock 
they have. He protested vigorously against the gross injustice of any legal presumption 
that because a particular sample of milk had a percentage of butter fat or a percentage of 
solids-not-fat below a prescribed minimum, the milk had been adulterated. It might, he 
thought, be quite reasonable to forbid the marketing of such milk, but certainly not right 
to affix a stigma to the farmer. Tocher was a good biometrician and a good practical 
Christian. 

In attempting to give a personal impression of Tocher, a writer who also knew two of his 
Aberdonian friends, Charles Creighton (1847-1927) and William Bulloch (1868-1941), both 
of whom left classical contributions to scientific literature, is tempted to compare them. 
Creighton was, in the old-fashioned sense of the word, the greatest scholar of the three. 
His History of Epidemics in Britain is a classic and other of his less-known writings would 
have been approved by Dr Johnson. Bulloch, less familiar than Creighton with the ancient 
writers, had an encyclopaedic knowledge of modern pathological literature and readers of 
this Journal are likely to remember his contribution to the T'reasury of Human Inheritance, 
his study of Haemophilia which, incidentally, contains many illustrations of the irony which 
made Bulloch a famous raconteur. I do not think Tocher was the equal of these two friends 
in scholarship or literary power, but—although to some who perhaps over-value formal 
scientific training it may sound paradoxical—I should say he was a better, a more original, 
scientific investigator than either. Epidemiologists will never forget Creighton, bacterio- 
logists will never forget Bulloch. Biometricians, I hope, will read Tocher’s papers and show 
their gratitude in the way he would most have appreciated, that is by completing some of 
the tasks to which he put his hand. 


Tocher had always been a good friend of this Journal and he became a Trustee on the 


inception of the Biometrika Trust in 1936. Major GREENWOOD 
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ON SOME MODES OF POPULATION GROWTH LEADING TO 
R. A. FISHER’S LOGARITHMIC SERIES DISTRIBUTION 


By DAVID G. KENDALL, M.A. 
Magdalen College, Oxford 


1. R.A. Fisher (1943) in a co-operative study written with A. S. Corbet and C. B. Williams 
has developed a mathematical theory which describes with some success the relative 
numbers of animals of different species obtained when sampling at random from a hetero- 
geneous population. This problem was first considered in relation to (i) Corbet’s work on 
the distribution of butterflies in the Malay Peninsula, and (ii) the numbers of moths of 
different species caught in a light-trap over a given period of time (Williams’s data). Fisher 
began by assuming that for a particular species the number of individuals caught in time ¢ 
would be distributed as a Poisson variable of expectation wt, where w may be called the 
intrinsic abundance of the species. He suggested that » might be distributed in the Eulerian 
(or x?) form l (: k 


Te a) ekwlQyk-ldwy (0<w<o), (1) 


where Q is the mean value of w and k is a constant parameter, and showed that the actual 
number caught would then follow a negative binomial distribution with index k*. In fitting 
such a distribution to Corbet’s data he obtained very small values of k, and this suggested 
that it might be worth while examining what would happen if Q and k were allowed to tend 
to zero in a constant ratio. In this way Fisher found that if a species were known to have been 
caught, it would be represented in the catch by exactly n individuals with a probability 

ax” € 

= (n = 1,2,3,...), (2) 
wheret y=In es > &= oa and a= limQ/k. 

l-—zx 1+at 

The success of this ‘logarithmic series distribution’ in graduating the entomological data 
of Corbet, Williams and others implies that in the populations concerned the distribution of 
intrinsic abundance must be (for w not too small) effectively of the form 

Ae~“@dw/w (A = constant). (3) 
(This cannot of course be true for all w, for then the integral of total probability would not 
converge.) It wili be noticed that the distribution (3) of intrinsic abundance is itself the 
continuous analogue of the logarithmic series. The success of (2) in describing the relative 
numbers of individuals caught is thus a challenge to biologists to provide a theoretical 
interpretation for (3). 

In this connexion it is worth noting that if one is concerned with a population containing 
only a finite number (Z, say) of species, then the continuous distribution (3) can be replaced 
by a logarithmic series, and results similar to those of Fisher follow as before. Thus, suppose 
that the actual number v of individuals by which a particular species is represented in the 
whole population is distributed in the discrete form 

= (v = 1,2,3,...), (4) 


* This step in the argument is of course equivalent to that taken by M. Greenwood & G. U. 
Yule (1920) in another context. t I write In z for the natural logarithm of z. 


oe oO ee 2a 


ee ee ee, ee ee | 
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where Y = —In(1—X), and let p = 1—e-” be the chance that an individual will be caught 
in an exposure of duration ¢. Then the chance that the species will have n = 0, 1, 2,3,... 
representatives in the sample is given by* 


P=1-% and P,=(1- B= (n>0), (5) 
i.e. a logarithmic distribution with a zero term added. Here 
x=l-e and ev—1 = (e¥ —1)(1-e%), (6) 
and so y< Y for all t; for very small exposures p will be small and then 
y= yt(e¥ — 1), 
while for very long exposures p will! be nearly equal to unity and then 
y= f. 


The expected values of S and N (the number of species and the number of individuals in 
a §=2Z-P)=yZ/¥ and N=(-1)Z/Y. 
Thus as too, S>Z and N-(e¥ —1) Z/Y, while for all values of i 

S =aln(1+N/a), (7) 
where «a = Z/Y is a constant independent of the time of exposure and corresponding to 
Fisher’s ‘index of diversity’. Formula (7) is, in fact, identical with the well-known result 
due to Fisher (1943), although the derivation given here proceeds from somewhat different 
assumptions. 

Williams (1944a, 6) has shown that the logarithmic series (2) can also be applied to a great 
variety of other biological problems, in which the integer n is variously the number of species 
per genus, the number of genera per subfamily, the number of parasites per host, and even 
the number of research papers per biologist (published in a particular year). It is hard to 
believe that a single mechanism will be found to explain the relevance of the logarithmic 
series to all these problems, and it seems therefore well worth while to record any theoretical 
models which may be found to lead mathematically to this distribution. In the remainder 
of this paper I shall describe a number of discontinuous Markoff processes which lead to 
distributions of negative binomial and logarithmic series form, in the hope that some of 
these may be found to be of biological significance. 


2. The stochastic processes to be considered here wiil for convenience be described in 
relation to the growth of a hypothetical population of organisms, whose numbers fluctuate 
with the incidence of mortality, reproduction (by binary fission) and immigration from the 
outside world. Let n be the size of the population at time ¢; then n(¢) is a random function 
which develops in the following manner: 

(i) If n > 0, the only possible transitions in an element of time dt are from x to n—1, n or 
n+ 1, and the transition probabilities are 


| n+1 with probability (nf+x«)dt, 
nin with probability 1—(nu+nf+x«)dt, 
MN —1 with probability nydt. 
* It appears that this sampling property of the logarithmic series distribution (which is easily proved 


with the aid of the generating function) has already been noticed by C. B. Williams (1947) and 
M. H. Quenouille. 
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(ii) (This is actually included in (i), but an explicit statement is desirable.) If n = 0, the 
only possible transitions in time dé are from 0 to 0 or 1, the transition probabilities being 


1 with probability «dt, 
By {0 with probability 1—xdt. 


Let P,(t) be the probability that at time ¢ the population size is n; then it is possible to set 
up an infinite system of differential-difference equations which together with the distribution 
{P,,(t)} at some initial time ¢ = t, determine the {P,,(¢)} at all subsequent times, and so govern 
the mode of growth of the population. Two alternative sets of initial conditions will be 
considered here: 


(A) P(-T)=1 and P,(-T)=0 (n>0). 
This implies that at time t = — 7' the population size was zero. 
(B) P(-T)=0, B(-T)=1 and P(-T)=0 (n>1). 


This implies that the population commenced with one individual at time ¢ = — 7. 

Next it is necessary to give a biological interpretation of the effects associated with the 
constants #, 4 and x. 

The first of these, 8, represents the reproductive power of the individuals composing the 
population, the effects of sex and age being ignored. Thus it is supposed that if attention is 
focrsed on any one individual at time ¢, it will be found to undergo binary fission at a time 
t+7, where 7 has the probability distribution 


e*tBdr (0<1T<0). (8) 


An important consequence of the assumption (8) is that the time to the next subdivision, 
for any individual, is statistically independent of its past history, and in particular it is 
independent of the length of time since that individual was itself formed by the fission of 
its parent, At first sight it might appear that a bacterial colony would provide a good 
example of such a population growing by binary fission, but it must be remembered that the 
generation times of bacteria, while liable to considerable random variation, have a frequency 
distribution* very different from (8) and possessing a pronounced non-zero mode. 

The n individuals present at any time are assumed to reproduce themselves independently 
of one another, and at the same constant mean rate. At each subdivision the parent can 
be thought of either as being replaced by its two offspring, or as only adding one new 
member to the colony and remaining a member itself; a transition n->n+1 then takes 
place. 

In a similar way the constant y represents the loss to the colony due to ‘mortality’. It is 
assumed that an individual does not lose its power to reproduce unless it ‘dies’, and that it 
then ceases to be regarded as a member of the colony, so that a transition n>n—1 takes 
place. Such a transition could, however, also mean the removal (by any means) of an in- 
dividual from the region considered; these two sources of loss are mathematically indis- 
tinguishable and will therefore be covered by the same symbol y. Thus if an individual is 


observed at time ¢, it will disappear from the population at a time ¢+7, where 7 has the 


distribution erudr (0<1<0). 


* See, for example, Kelly & Rahn (1932) and Hinshelwood (1946). 
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The £- and y-effects, described separately, are to be thought of as acting simultaneously 
and independently one of the other. Thus, when the f- and y-effects are acting together, the 
chance that an individual remains inactive for a time 7 and then subdivides during the 
subsequent time interval dr is ett Bar. 


Integration from 7 = 0 to r = 00 then gives the chance that. the individual will subdivide 
before the y-effect has removed it from the colony; this is 


7 B 
i) eBter Bdr = : 
0 B+p 
Finally the x-effect is one of ‘immigration from outside’, i.e. it is supposed that from time 
to time individuals not initially members of the colony may join it and proceed to behave 
exactly like the other members. If, from a given time instant ¢, the next such ‘immigration’ 
occurs at time ¢+7, the distribution of T is assumed to be 


e*“txdr (0<T<0o). 


The structure of the model will now be clear. It only remains to point out that the pro- 
babilities of a positive unit increment from the f-effect or a negative unit increment from the 
u-eftect in an element of time dt will each be proportional to n, the existing population size, 
while the chance of a unit positive increment from the x-effect is the same for all values of n. 


3. The differential-difference equations of the process can now be written down. They are 


S Plt) = (m+) HPaarll)— (n+ 0) +} PA) + (2-1) 8 +.B, (9) 
if n>1, and © Pt) = wP,(t)— KP). (10) 


It is convenient to define P,,(t) as being identically equal to zero when x < 0; equation (10) can 
then be included within the general form (9). I owe to Dr M. 8. Bartlett the remark that 


systems of equations of this type can most conveniently be solved with the aid of the gene- 
rating function 


$(z,t)= DY 2F, (0). (11) 
It will be seen from (9) that ¢(z,?) must satisfy the partial differential equation 
0 Q 
oP = (u— (B+ p)2+ BL + x(2—1)9, (12) 
which together with one of the boundary conditions, 
(A) o(z,—T) = 1, 
or 
(B) $(z, .— T) = 2, 


and the requirement that the expansion of ? must contain no terms in 1/z, 1/2°, ..., is sufficient 
completely to determine the process. 


The differential equation (12) is of the standard Lagrangian form, the auxiliary equations 
being 
-dt = > or. (13) 
(Bze—p)(2—-1) (2-1) 9 
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‘First integrals’ are (f—)t+In(z—1)—In(fz—y) = constant, 
and «In (fz—y)+ #lng = constant, 

if «> 0 and £+,, and so the general integral of (12) is then 


2,0) = (u—fey-eh@ [PE (14) 


where © is an arbitrary function to be determined from the boundary conditions. 
With boundary condition (A) it will be found that 


where A has been written for e#-“)T (this is equal to the expected factor by which the popula- 
tion will be multiplied in a time interval 7’, when it is growing in the absence of immigration). 
Similarly with boundary condition (B) one obtains 
Me leet. dhs Es * 
G(z, 0) a 5 (BA — py tid {u(A mat. 1) ee (HA B) z} 1 
where A has the same meaning as before. 


When «x = 0, the solutions are of a slightly different form. The general integral of (12) 
is then 





B(A- oe, (16) 


BA-p4 


es | dee Pe 
He,t) = Oe. (17) 


Condition (A), as might be expected, gives ¢(z, t)=1; this merely asserts that a zero popula- 
tion will remain zero if there is no immigration. Condition (B), however, gives 


0) = ~ — 18 
f(z, ) pA-p \ pA-yu *| ( ) 

It will be noticed that in every case the solution is a regular function of z near z = 0, so 
that in the Laurent expansion the coefficients of the negative powers will all vanish, as 
required. 


4. It isnow a simple matter to interpret these solutions. There are three cases of special 
interest. 

(i) Consider first a population growing from zero, so that (A) is the appropriate boundary 
condition, the population being established in the first instance by immigration from 
outside. The x-effect is of course acting all the time, even after the colony has started growing, 
so that in general there will at any time be present a number of independent families, each 
descended from a different immigrant ancestor. According to (15) the population size n, 
after the process has been developing for a time 7’, will be distributed as a negative binomial 
variate with index «/f and mean value 


E(n) = ce ) (19) 


Thus if # > u, the expected size of the population will for large 7' grow geometrically at an 
exponential rate (/—). 

If, however, £ < #4, so that the force of mortality more than compensates for the force of 
reproduction, one will have 


lim E(n) = — (20) 


To u—-B 


sc 
to 


su 
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This is the mean of the stable distribution of population size which can just be maintained 
by the immigration rate x. If x were equal to zero the population would almost certainly die 
out in a finite time. 

(ii) Now suppose that x is very small, though still just greater than zero; to be more precise 
suppose that the ratio x/f is negligible, so that while immigration is sufficient to start off 
the process, and to restart it if ever the population is wiped out by an excess of the p-effect, 
it is negligible when compared with the contributions from the £-effect while the colony is 
actually growing. Then, exactly as in Fisher’s analysis referred to in § 1, it will be seen that 


the size distribution of such a colony observed at any time will be a logarithmic series: in 
fact the distribution of n, given that n > 0, is* 


x” 
ny (n = ie 2, 3, > 
where as always y = —In(1—2), and 
eee) (21) 
pA-p 
If T' is very large, then z~l -( -!)5 when f>4, (22) 
and x~Piu when P<p. (23) 


The second case is the more interesting, for one can then let 7’ tend to infinity and so obtain 
the stable distribution of population size when # <j. Of course in the limit when x = 0 
it is ‘almost certain’ that n = 0. If, however, a colony does exist (i.e. if n>0), then it is 
almost certainly homogeneous (descended from a single immigrant ancestor), and its size 
n will be distributed in a logarithmic series. 


(iii) The case 8 = yw, when reproduction and mortality just balance, requires a separate 
discussion. The equations auxiliary to (12) are now 


dz dd 


Oe = Be Ke 





and the general integral is f(z, t) = (l—z)-*#® A + =| . 
Condition (A) then gives 


T —«/p 
#2, 0) = (14 pT)" f1- al : (24) 


so that here again n is distributed as a negative binomial variate with index «/f, but the 
mean value is now 





E(n) = xT, (25) 


so that the expected size of the population is linearly proportional to the time of exposure 
to immigration. If «/f is very small the limiting conditional distribution of n (given that 
n > 0) is once again the Fisher series 


ax 
—- = 1,2 
ny (n = 1, 2,3, ...), 
T 
where now <= a (26) 


* This conditional distribution is of course obtained by taking the ratio of the general term to the 
sum of all the terms but the first, in the negative binomial series, and then letting x/f—0. 
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5. It will perhaps have been noticed that in the analysis of the last section the immigra- 
tion rate x (when «/ is small) merely has the effect of ensuring that an observed population 
is almost certainly descended from a single immigrant ancestor who entered the region 
considered at some instant during the time interval of length 7 preceding the moment of 
observation. I think this gives us a clue to the true ‘explanation’ of the occurrence of the 
logarithmic series in the solution to the problem just considered. Before exploring the matter 
further it will be found helpful to examine the growth of a single family by setting x = 0 and 
starting from unit population at time t = — 7’, thus employing boundary condition (B). 


From the generating function (18) it then follows that the distribution of the population 
size n at the time of observation (¢ = 0) is* 


PB eri and P, =(1—P,)(l—u)u*™" (n>0), (27) 
B(A-1) 
where “= ———. 
BA-p 
The distribution is thus a geometric series with a modified zero term, the mean population 
size being E(n) = A, 


so that the expected population grows geometrically at an exponential rate # — y (which will, 
of course, be negative if £ < y). 


It is of interest to evaluate the variance of the population size. This proves to be 





Var (n) = E(n— A)? = Fie MA- 1), (28) 
and the coefficient of variasion of the population size is thus 


IU522) 6-4) « >» 
ws (29) i-9) # a0 


For large 7’ these expressions become 


C. of V.(n) ~ J) if B>p, (29) 
ana C. of V.(n) = [Rte | if B<p; (30) 


in the second case it will be recalled that Z(n)—>0 as T'->oo. 

The distribution of the population size thus behaves rather differently in the two cases of 
an exponentially growing and an exponentially decreasing population; this agrees with 
a conclusion reached by M.S. Bartlett (1937). He considered the similar problem when there 
is no spreading of generations and the generation-time is rigorously constant. As he points 
out, there is a connexion with Fisher’s theory of the extinction of rare characters and, one 


might add, with the work of Francis Galton, H. W. Watson, and A. J. Lotka on the extinction 
of surnames.t 


* (Added in proof.) Dr Bartlett has pointed out to me that the result (27) is stated by N. Arley 
& V. Borchsenius in Acta Math. (1945), 76, 298-9. It is attributed by them to Dr C. Palm. 

+ See Fisher (1930), Galton (1889) and Lotka (1931). The problem of the distribution of surnames, 
and its variation in time, seers not yet to have received all the attention it deserves. The surname is 
@ ‘rare character’ whose extinction can very readily be observed; normal social conditions ensure that 
it is inherited as if it were controlled by a gene totally sex-linked in Y. Reference may be made to the 
work of R. A. Fisher & Janet Vaughan (1939), and J. A. Fraser Roberts (1941-2), whe have considered 


the relation between surnames and blood-groups. [See also reference to Tocher & Gray, p. 1 
above, En.! 
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When £ = y, so that the forces of reproduction and mortality just balance, the above 
solution must be modified. The appropriate results are most easily obtained by letting 
tend to 4 in the several formulae. In this way one finds 


pT 


P, = i+ pF and P,=(1—P)(l1—u)u™" (n>0), “2 ee 
: pr 
where “e= 14,7" 
and so E(n)=1, Var(n)=2f8T and C. of V.(n) = (287). (32) 


It is of interest to note that if # and y~ instead of being constants are each proportional to 
the same function of the time,* the above theory still holds, provided that 7’ is everywhere 
replaced by 


[voa, 
where £ = Ayy(t) and w = py (t). 

6. Consider now the size distribution of a colony developing in the absence of immigration 
and known to have originated from a single individual whose arrival in the region concerned 
occurred during the preceding 7' time-units. If the time of arrival of the common ancestor 
is a random variable uniformly distributed from ¢ = — T' tot = 0, it will follow from (27) that 














1 (7(B(A—1)\"* BA(b- pn? 
P, == >1), 
spo |,\pian) aaa PD 
« . d (B(A- | BA(B— py? 
where A = e4-“", Nowsince — ~ =>° 
dt\ BA—n}~ (BA—p}? 
this can be written P= 7 ce du = fad 
" pr), npT° 
‘ 1 
while P, = a! as 
: A-1) 
U being the value of c= Bl 
: pr=u 
when 7 = 7'. Thus the distribution of the population size at the time of observation (¢ = 0) is 
1 1 x 
A(A—1) 
where 2 ; 34 
BA-p - 
y and A being defined as before. For large 7’, 
~iulictee a 
ezl (: Ab if P>yp, (35) 
and a~Blu if B<p. (36) 


In the latter case it is permissible to let 7' tend to infinity and so obtain the stable (logarithmic 
series) distribution for n (given that n > 0). When f = yu the (z, 7) relation is x = £7'/(1+,87). 

It will now be clear why, in § 4 (ii), the boundary-condition (A) together with the hypothesis 
n> 0 led to a logarithmic series distribution for n as x/8->0. For in these circumstances it 


* A discussion of the similar problem when f and y# are any (not necessarily the same) functions of 
the time will be given in my paper (1948). 


mn, 
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would be almost certain that an observed population was wholly descended from a single 
immigrant ancestor who arrived in the field of observation at an unknown time instant 
uniformly distributed between ¢t = — T and t = 0.* 


7. The classical theory of population growth (see, for example, A. J. Lotka (1945) for 
a general review and extensive references) is largely based on a deterministic description of 
the phenomena, which leads to differential and integral equations for the expectation values 
of the random variables concerned (the total population size, and the numbers in the several 
age groups). Apart from the work on ‘extinction’ already mentioned, the first stochastic 
treatment of the general problems of population growth seems to be that of W. Feller in an 
important paper} which is unfortunately not generally accessible in this country. Feller’s 
work has been further developed by N. Arley (1943), who showed that discontinuous Markoff 
processes of a similar type are equally relevant in the theory of the ‘cascade showers’ 
initiated by cosmic ray particles. In particular he makes use of the simple birth-and-death 
process discussed here in § 5, and quotes Feller’s formulae for the mean and variance of n as 
functions of the time ¢t. Arley gives an elegant method for determining an expansion for 
P,,(t) in powers of (t —t)), and observes that the calculation of high order coefficients becomes 
very cumbersome. One can now see, on examining the complete solution contained in (27), 
that this is very reasonable, for P,(t) is quite a complicated function of the time t, although 
a simple one of the reduced variable w. 

The results of the present paper would not have been obtained without the generating- 
function technique for transforming the differential-difference equations into a partial 
differential equation of simple type. This device was suggested to me by Dr M. 8. Bartlett 
in the summer of 1946, and he has also applied his method to a number of Markoff processes 
of interest in biology, one of which is the birth-and-death process of §5. An account of this 
work is now available (Bartlett, 1947). In another place I intend to give a discussion of 
the most general birth-and-death process of this type, in which the birth- and death-rates 
f and y can be any functions of the time ¢t (Kendall, 1948); this development also makes use 
of the generating-function procedure. 


It is a pleasure to acknowledge my indebtedness to Dr Bartlett and to the many other 
friends whose comments have helped to clarify my ideas on this subject. In particular, 
I should like to thank Mr D. J. Finney and members of his Seminar in Biological Statistics 


in Oxford, and Mr F. J. Anscombe, Dr P. Jones and Dr C. B. Williams of the Rothamsted 
Experimental Station. 


* The condition n>0 is to be introduced after (33) has been established. If it were imposed from 
the start, the a posteriori distribution of the time of arrival of the immigrant ancestor would no 
longer be a uniform one, but the appropriate modification of the argument would lead to the same 
final result. 

t Feller (1939). I am greatly indebted to Prof. Feller for the gift of a reprint of this paper. In private 
correspondence he tells me that he also, in unpublished lectures, has solved the equations governing 
the birth-and-death process discussed here in § 5. 

¢ Arley’s monograph is also of great value in presenting a useful account (including several new 
developments) of the Kolmogoroff-Feller theory of Markoff processes, especially those of the discon- 
tinuous type used here. Another excellent account has been given recently by O. Lundberg (1940). For a 
general introduction to this subject, reference may be made to my review article (1947). 
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THE STUDENTIZED FORM OF THE EXTREME MEAN SQUARE 
TEST IN THE ANALYSIS OF VARIANCE 


By K. R. NAIR 
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Part I. EXPANSION OF THE STUDENTIZED INTEGRAL: 
EXTENSION OF H. O. HARTLEY’S RESULTS 


1. Introduction 


Let 2,, ...,%, denote a sample of n observations drawn from a normal population with mean 
m# and standard deviation o. Then the difference between sample and population mean, 
%—, is normally distributed with zero mean and standard deviation a/,/n. If we estimate 
the standard deviation of the parent, 7, by 


s = V[Z(e—2)4/(n—1)], 
then ‘Student’ (1908) gave the distribution of 


t = (@—p),/n/s. 
As was to be expected, this distribution was independent of 7. The knowledge of the dis- 
tribution of t made it possible to draw inferences, with the help of evidence entirely supplied 
by the sample, about the location-parameter ~ of a normal population, without making 
any assumptions about the generally unknown scale-parameter, o. 

Neyman & Pearson (1928) extended this notion to an analogous problem connected with 
the rectangular and exponential populations. 

Fisher (1924) obtained the distribution of s’/s where s’ and s are two independent estimates 
of ¢, calculated by the root-mean-square method. This distribution is also independent of c. 
Fisher also showed that ‘Student’s’ ¢-distribution could be extended -to a wide range of 
sampling problems. Sukhatme (1937) has shown that analogues to ¢ and s’/s of ‘normal 
theory’ can be developed for an exponential population, again eliminating the unknown 
scale parameter. 


This notion of eliminating unknown scale parameters from the distribution laws of 
statistics has come to be known as ‘studentization’. 


{ Part of a thesis approved for the degree of Ph.D. of the University of London. 
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If instead of s’ and s which give unbiased estimates of o, we use other types of statistics 
which are ‘proportional’ to 7 ,* such as the range, mean deviation, etc., it is clear that the 
distribution of the ratio of two such estimates will be independent of c, although the analytic 
expression for this distribution may be difficult to obtain. 

Hartley (1938, 1944) has shown that if instead of s’/s we have a ratio w/s, where (i) w is 
a general statistic ‘proportional’ to o calculated from a sample of n observations 2, ..., 2» 
drawn from a normal population and (ii) s is independently distributed with v degrees of 
freedom, then the distribution of w/s can be derived without much difficulty if the distribu- 
tion of w/o is known. His solution is described in some detail in the next section and its 
application to special problems is considered in the succeeding sections. 

The probability integral of w/s may be called the studentized integral of w. When v->0co 


the studentized integral becomes identical with the probability integral of w/o, which 
may in turn be called the 00-integral of w/s. 


2. Expansion of the studentized integral in powers of vy-* 
Let f,(w/s) denote the distribution function of w/s. When v—>oo this gives the distribution 
function of w/o, which we shall denote by f(w/c). 
Let the probability integral of w/s be 
Q 
PLQ) = [fis dew)s) 


0 


When v— oo, P(Q) gives the probability integral of w/o which we may denote as P(Q). 
Assuming o to be unity, it follows (see, for example, Hartley) that 


P(Q) = 21 (4v) (Any { “ete P(Qs)ds, (1) 


Hartley made the significant discovery that a recurrence formula connecting P(Q) and 
P,_,(Q) could be built up and that, thereby, P(Q) can be obtained as the solution of a partial 
differential equation. He solves this equation by iteration, and at the third stage obtains 
the first three terms in an expansion for P.,(Q) in powers of v—!, namely, 


1 1 
FQ) = P(Q) +7 (@*P"— QP’) + (avy (3Q*Pv — 20° P" — 3Q°P" + 3QP’), (2) 
where the derivatives of P are taken at the argument Q. 
For v of the order 20 or larger this formula will in most cases give quite sufficient accuracy. 
Sometimes when p is small, however, we may need at least the next two terms of the expan- 


sion. The term in v-* immediately follows from equation (24) of Hartley’s (1944) pape and is 


32 
Fao" Fad? + SAPS" + 36"), (ayt 
where (A) = P(e’) = P(Q) and z= log vy. 


The term in v~ will come from the fifth stage of the iteration which involves some lengthy 
algebra. In terms of x, ¢ and A this becomes 


30 (as (158""" — 360g" + 3320g"! — 147849" + 322401" — 28800" + 12808" + 61449"). (4) 


* A statistic w is ‘proportional’ to ¢ if it transforms into w/o when the observations x; are measured 
in units of 7. 
+ The coefficient of ¢” is misprinted —44 for —4¢ in Hartley’s paper. 
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The derivatives of (A) can be expressed in terms of those of P(Q). 
P(A) = P(Q), 
¢ =QP’, 
~” =Q*P"+QP’, 
go” = Q@P"+3Q?P"+ QP’, 
oY = QP + 6Q3P” +7Q?P"+ QP’, 








j (5) 
PY = Q>Pv+ 10Q*Pv + 25Q8P” + 15Q?P" + QP’, 
fi = QEPvi+ 15Q5 Pv + 65Q* Pv + 90Q3P” + 31Q?P"+ QP’, 
PY'l = Q7Pvil + 2198 Pri + 140Q5 Pv + 350Q4 Ply + 301Q8P” + 63Q?P" + QP’, 
pvill = Q8Pvill + 28Q7 Pvil + 266Q% Pvi + 1050Q> Pv + 1701Q4 Pv + 966Q3P” 
+127Q?P"+ QP’. J 
Substituting these in (3) and (4) we get, up to terms in p~*, 
P(Q) = dy + ,/V + ay/v* + 43/9 + a4/ V4, (6) 
where ay = P(Q), ) 
a, = 1(Q?P"—-QP’), 
4 Piv _ 2¢93P” — 302P” , 
a, = was 9° Pv —2Q8P” —3Q?P" + 3QP’), 
(7) 
a, = wan (OP + Q5Pv—7Q*PW + 12Q3P" — 15Q2P” + 15QP’), 
1 
= ———__— (]§Q8 Pvili + §60Q7 Pvil — 25 6 Pvi4 5 Pv 
a, 360(44 (150 Pviii4 60Q7P 50Q* Pv + 366Q° Pv, 
— 285Q4 Pv — 30Q3P” + 945Q2P” — 945QP’). 
From (7) we can derive the following results 
32 : 128 2048 
for’ dQ = = -5 la: dQ = = - 35 (0 = 105 a,dQ = rasp (ste. 
1 i ] 
Jer dQ = - {0,49 = i =— | eas =— 5 | @de. 
" 8 
2048 (8) 
[or dQ = -5 [ea dQ = — wag | dQ =- vr | Oe" dQ =—- iss [Ort 
| QtP'dQ = —> iJ Q'a,dQ = — 7 r QPa,4Q = — 5, | Pade = - 75, [Pade, 





where the limits of integration are 0 and oo. 


These results enable us to express the moments of the studentized statistic in terms of 
those of the non-studentized statistic. Thus, up to terms in v-*, we have 


25 5S ” ; 
I Q)dQ = i P(Q)dQ- (7 + goat ign t oaee) |, QP'(Q)aQ, 
[f ert@rag = ["erqae-(-+5+5+5)[" @Parag. 

3 1575 76153 
ae Qd@ = [" err(qde- (2+ satis tapiee) |, PP (Qe. 
[re 


Q)dQ = | ere 4Q-(Ftatetor) |, Q*P'(Q)dQ. 


> = (9) 











5) 


(6) 


(7) 


(8) 


s of 


°) 
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3. Application to the incomplete beta-function 
By applying expansion (2) to the prebability integral of the square root of a variance ratio 
having 2p and 2q degrees of freedom, Hartley obtained a new formula for the incomplete 
beta-function T(p+q) f? 
Ip) Ta@)Jo 
in terms of the incomplete gamma-function and its derivatives. 
Using the additional terms in v~* and v~ given in (6) this formula becomes 





I(P,4) = aP-*(1 —x)t* dx 


[,(P,4) = Pippa” ery tdy + P(p) e-*w?{b, /(2q) + bg/(2q)? + bs/(2q)* + b4/(2q)*}, (10) 
where x = w/(w+q) and 

b, = {(p—1)—o}, 

by = ${(p—1) (p—2) (3p +1) — (p— 1) (9p — 2) w+ (9p — 1) w* — 3a}, 

b, = ${p(p— 1)? (p—2)(p—3)—p(p— 1) (p—2) (5p— 3) + 2p(p— 1) (5p— 1) 0* 
— 2p(Sp + 1) + (5p + 3)w*—w*}, 

bs = se0((P— 1) (p—2) (p—3) (p—4) (15p* — 30p? + 5p + 2) 
—(p—1)(p—2) (p—3) (105p3 — 1835p" + 10p + 8) 
+(p—1)(p—2) (315p3 — 180p? + 5p + 12) u2 
— (p—1) (525p* + 75p? + 50p + 8) w* 
+ (525p3 + 450p? + 175p + 2)u4 
— 5(63p? + 99p + 46) w* + 15(7p + 9) w* — 150}. 


- (11) 





This formula strictly applies only when p and q of the incomplete beta-function are such 
that 2p and 2q are positive integers. It is not suitable when p is large, because of the slow 
convergence of 6;/(2q)*. For small values of p and moderate or large values of g, however, 
the formula is quite useful. For large p and g, Wishart (1927) and others have developed 
useful methods. 

To give some idea of the accuracy of the formula when only terms up to 6, are used, Hartley 
considered the example p = 1, w = 5° and various integral values of q in the range 5 to 50. 
The agreement between the exact and the approximate values was very good for values 
of g> 20. For lower values of q, addition of the terms in 6, and 6, makes the approximations 
closely agree with the exact values. 


Table giving exact and approximate values of I,( p,q) for p = 1, w = 52 and x = w/(w+¢q) 











Approximation 
q Exact 
(1) (2) (3) 

5 0-976 155 0-974 627 . 0-975 597 0-976 788 
10 0-987 945 0-987 774 0-987 896 0-987 970 
15 0-991 140 0-991 093 0-991 129 0-991 144 
20 0-992 571 0-992 553 0-992 568 0-992 572 
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In this table approximation (1) uses terms up to 6,, and approximations (2) and (3) 
are obtained by including terms up to 6, and 6, respectively. The last approximation gives 
values in excess of the exact values, which shows that the valne of the omitted remainder 
terms for w = 5° is negative, though negligible when q exceeds 10. 


4. Application to ‘ Student’s’ integral 


Fisher (1926) gave an expansion for the probability integral of ‘Student’s’ ¢, in powers 
of v-!. He worked out the coefficients of the terms up to v-* and found that the maximum 
value of the fifth correction never exceeded 10-5 when v was greater than 18. It will be 
interesting to compare the coefficients in Fishex’s expansion with those obtained by applying 
Hartley’s method. 

Since ¢ is symmetrically distributed about 0, we may consider the probability integral 


of | ¢|. To get the expansion of this integral by Hartley’s method we have only to replace the 
P(Q) in (6) by the ‘oo-integral’ of | ¢|, namely, 


Q 
PQ) =, [=| eat. (12) 


Alternatively, since | ¢| is the same as the square root of a variance ratio having 1 and v 
degrees of freedom, putting p = }, q = 4v and w = 3? in (10), we may obtain its probability 


integral in the form 9 itl 2 4 
= +8 dz— /—|t)e# > Tr", 13 
Lin]y e-file MEP - 
where 17, = }(é+1), 


sie ate: — 774 — Fs 
= Gay (O— TH 5-3), 


l (14) 
T, = ——x (#!° — 1148 + 144° + 6¢4— 3#— 15), 


T, 





= —____ (1 5¢'4— 375¢12 4 2225410 — 214178 — = 246 
7; 360(4%) | 5t 3750? + 5t & — 93928 — 213¢4 + 915¢ +o 
The probability integral of ¢ from ¢ to 00 immediately follows as 





1 f° 1 4 
= —ta* qj + te” T, Ss 15 
Tami ae ”) 


r=1 
The coefficients 7,, 7;, T; and 7,* are identical to those given by Fisher providing us with 
a useful confirmation of the general applicability of Hartley’s method. 


5. Some further applications 


In his 1938 paper, Hartley examined the studentized probability integral of the largest 
and smallest among k independent estimates of a variance, each having | degree of freedom. 
The importance of this problem in the analysis of factorial experiments was first pointed out 
by Wishart (1938). As an expansion of the integral in powers of v-! was not then known, 
Hartley approached the problem by an approximate method which was satisfactory for 
getting the lower percentage points of the smallest variance, but not for the more important 
case of upper percentage points of the largest variance. 


* The coefficient of ¢? in 7, appears with a negative sign in Fisher’s (1926) paper but the correct 
sign has been used in a later paper, viz. Ann. Eugen. 11, 141-72. 
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Meanwhile, Finney (1941) gave an exact solution for the studentized integral of the 
largest and smallest of k variances, each estimated with m degrees of freedom. It is not easy 
to make this exact solution amenable to numerical calculation of the percentage points for 
odd values of m. Hartley’s expansion (2) with the additional terms given in (6) could usefully 
be employed to get the percentage points when m = 1. Details of the method and tables of 
the 5 and 1 % points are given in Part IT. 

Pearson & Hartley (1943) used expansion (2) to calculate the studentized integral of the 
range. This is the probability integral of (x, —2,)/s, where x, and x, are the two extreme 
observations in a sample of n observations and s is an independent estimate of o based on 
v degrees of freedom. The studentized range is of importance in quality control charts for 
industrial products. A closely allied statistic, namely, the studentized extreme deviate 
(x, —%)/s (or (—2,)/s) has useful applications in designed experiments when we are con- 
cerned with judging whether a single outlying treatment (best or worst) really differs from 
the rest. The probabili’ integral of this statistic will be considered in another paper (Nair, 
1948) and tables provided for m = 3, 4, ..., 9. 

There are many other examples where the expansion of the studentized integral can 
usefully be employed.The applications cited above are convincing proof of its potentialities. 


Part II. APPLICATION TO TESTS REGARDING THE LARGEST 
AND SMALLEST OF SEVERAL VARIANCES 


1. Introduction 


Let s, ...,s% be independent estimates of an unknown variance o* of a normal population 
each calculated from sums of squares having m degrees of freedom and arranged in ascending 
order of magnitude. Let s2? be another independent estimate based on v degrees of freedom 
against which each of the first k estimates is to be tested for significant differences from s?. 
In routine analysis of variance where such tests frequently occur, it is customary to test each 
of the k variances against s? and separately declare whether there is a significant difference 
or not. Forming now for each of the independent s? the ratio F, = s?/s, itis obvious that the 
largest ratio, Fj, = sj/s2, is more likely to be declared significant than any other variance ratio 
in the set. Indeed, for k = 20 it would be expected to be significant at the 5 % level of F 
for m and v degrees of freedom. This source of bias can be eliminated if the probability integral 
of the largest variance ratio is numerically evaluated. 

Although the theory discussed in this paper applies to any value of m, owing to practical 
difficulties, tables of the upper 5 and 1 °% points of the largest variance ratio have been 
prepared only when m = 1, which is the most important case in practice. Thus, as Wishart 
(1938) has pointed out, it has useful application in the analysis of variance for 2 x 2x 2x... 
factorial design. It could in fact be applied to the analysis of any designed experiment where 
the total variance due to treatment effects is split up into components each having a 
single degree of freedom. 

Another possible application is in the fitting of curves with orthogonal terms, e.g. ortho- 
gonal polynomials and harmonic analysis. It may well happen that while, taken as a whole 
there is no significant curvilinearity, the coefficient of a single high order term turns out to 


be very large compared to the rest. The new tables will be useful in testing whether such 
isolated coefficients are significantly large. 
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The theory developed for the largest variance ratio could easily be extended to any other 
ranked ratio. Of these the smallest, namely, F, = s?/s3 has been considered. Occasions to 
test the significance of the smallest of k variance ratios are much less frequent than that of 
the largest. In the former case, we are concerned with the lower percentage points of the 
probability integral, in order that a test could be made whether an observed smallest ratio 
is significantly small. 

In field experiments, the smallest of & variances tested may become significantly small 
compared to the ‘error’ variance (s?) if the m+1 groups of plot values from which the m 
degrees of freedom of that variance were obtained showed a high negative intra-class corre- 
lation. The extreme value that this correlation can have, if there are / plots in each group, 
is — 1/(i1—1), so that it can be — 1 only if = 2. Wishart (1938) again gives an example where 
a test for significance of smallest variance ratio when m = 1 is appropriate. 

A rather interesting use for the test of significance of the smallest variance ratio, when 
m = 1, can be found in certain methods of statistical control in sample surveys devised by 
Mahalanobis (1944). If, say, you are sampling agricultural fields in k districts and send two 
investigators to each district to collect half the quota of sample units into two randomly 
selected half samples A and B, a comparison of the A and B mean values for each district 
should give a clue as to whether the data have been properly collected. If one of the A-B 
differences is very large and the variance ratio significant it is usual to conclude that the 
two investigators concerned did not carry out the instructions in the same manner or that 
some other personal bias had crept in. On the other hand if one of the k differences between 
(A, B) pairs is surprisingly small and turns out to give a significant smallest variance ratio, 
it may perhaps arouse a suspicion that the two investigators consulted each other and dis- 
honestly made the means of their data agree. This is the negative side of the argument in 
favour of a test of significance of the smallest variance ratio. On the positive side, it may 
often turn out that the smallest variance ratio is not significantly small, avoiding awkward 
aspersions on the reliability of the investigators. 


2. Probability integral of the largest variance ratio 


Let ,P,(Q) denote the probability of s,/s, being <Q. This is the same as the probability 
of Fi, = sj/s2 being < Q?. When v->oo, this probability will be denoted by PF,(Q). 
Finney (1941) showed that 


rP(Q) = M*(1+A)-¥, (1) 
-* oe 
where M = (dm) yim-i e-¥ du, (2)* 
0 


and A is put equal to zero in (1) after differentiation. 


He found that (1) was not amenable to numerical calculations if m is odd. The simplest 
case is m = 2 for which the probability integral reduces to 





k -(2\ -v : 
PQ) = B(- are (1422). (3) 


r=0 


Hartley (1938) had suggested that if we assume the k variance ratios to be independent, 
an assumption quite justifiable if v is very large, ,P,(Q) can be obtained approximately from 


eae P(Q)= PQ). (4) 


* This appears as 1 — M in equation (10) of Finney’s paper through a printing error. 
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For m = 2, this becomes »P.(Q)= ft - (: + = a : (5) 


To get some idea of the adequacy of the approximate approach, Finney compared the 
5 % points for F,, obtained by the two methods, when m = 2. He concluded that the approxi- 
mation was satisfactory when v was moderately large in comparison with k, and presumed 
that the agreement would generally improve with increase of m. The chief uncertainty 
according to him was, therefore, when m = 1. 

An alternative method of calculating (1) which is particularly suitable when m = 1 is 
Hartley’s expansion «.* ». studentized integral. Thus, using (1) of Part I, the integral itself is 


PAQ) = 204») (vy | * a 'e- 4 PA(Qs,) day, (6) 


k 
: ml e—ima? ae) ; (7) 


/ Q 
where P,(Q) = (20am) (Jpn 


It could easily be verified that (6) and (7) lead to the same result as given in (3) when 
m = 2. 

In the form given by (6), ,P,.(Q) can be evaluated with sufficient accuracy using expansion 
(6) of Part I where P(Q) should be replaced by P,,(Q) given in (7). The coefficients ao, a,, dg, ..., 
of this expansion will be seen to involve powers and derivatives of the incomplete gamma- 
function, thus leading to Laguerre functions. When m = 1 or 2 these reduce to certain Her- 
mite functions which are fully tabulated in the British Association Mathematical Tables, 
vol. 1. In the general case, the Laguerre functions have to be used ; these have been tabulated, 
although less extensively. 

In the special case where m = 1 we have 


P,(Q) = (/-[ ewaz) (8) 


This can be expressed in terms of the Hermite function 


Hh,(x) -| et" dx (9) 
tabulated in the British Association Mathematical Tables, which also give values of 
d \" 
Hh_, (2) = (-3) Hhg(x) (10) 


for n = 1 to 7. These have been used in preparing the tables described in § 3. 
When m = 2, we have 


PQ) = (1—e-@")k 


{1—Hh_,(x)}*, where x= Q,/2. (11) 


The first six derivatives of the right-hand side of (11) can be obtained from the British 
Association Mathematical Tables. We could therefore proceed with Hartley’s method for 
the case m = 2 as well. It seems simpler, however, to use the exact formula (3). Finney has 
prepared a table of percentage points when k = 2 and 3. We shall consider only the case 
m=1. 








24 Studentized form of the extreme mean square test 


3. Construction of tables 
Writing P,(Q) as P,, for brevity, we have, for m = 1, 
(ia)"* P, = {/37— Hh,(Q)}* = A* (say), 
(47)** Pi, = kA*“Hh_,, 
(4a)! Pi, = k(k—1) A*"Hh2_, -kA*“Hh_,, 
(4a) Pe = k(k—1)(k—2) A* 3Hh3_, — 3k(k—1) A* *Hh_,Hh_,+ kKA*"Uh_,, 
(47r)#* Pi¥ == k(k—1) (k—2)(k—3) A* “HU, — 6k(k—1) (k—2) A* 3Hh2_,Hh_, 
+k(k—1) A*-*(3Hh2., + 4Hh_,Hh_,) —kA*“Hh_,, 
(4ar)* Py = k(k—1)(k—2) (k—3)(k—4) A* SHAS, — 10k(k—1)(k— 2) (kK -—3) A**HA8 ,Hh_o| 
+ 5k(k—1)(k—2) A*-3Hh_,(3Hh?., + 2Hh_,Hh_,) 
— 5k(k—1) A*-*(2Hh_,Hh_,+ Hh_,Hh_,) + kA*“Hh_,, 
(427)** Py! = k(k—1) (k—2) (K-38) (k—4) (k—5) A* “HAE, 
— 15k(k— 1) (k—2)(k—3) (k—4) A*5Hh* ,AHh_, 
+ 5k(k—1) (k—2)(k—3) A*-*(9Hh?_,Hh2., + 4Hh* ,Hh_s) 
— 15k(k—1) (k—2) A*-3(Hh®., + 4Hh_,Hh_,Hh_,+ Hh*®_,Hh_,) 
+ k(k—1) A*-*(10Hh2., + 15Hh_,Hh_,+ 6Hh_,Hh_,) -kA*“Hh_,. 





(12) 
These six derivatives are sufficient to calculate ay, a,, a, and a, of expansion (6) of Part I. 
Since a, involves Hh_, which is not included in the British Association Mathematical Tables, 
it is not easy to calculate a, by the direct method. The calculation of a, itself is rather com- 
plicated by direct evaluation from the derivatives of P, and was therefore accomplished by 
an indirect method of numerical differentiation from a, and a,. The same method could 
have been used to calculate a,, but the idea was abandoned as that term does not appear 
seriously to affect the accuracy, unless k is large and v is small. A small panel of values of 
a, was, however, calculated by this method for select combinations of values of Q and k to 
get some idea of its range of magnitude. These are discussed later in this section. 
Since values of Q* P{? were required, an auxiliary function 


h; = Hh_,QiAt (13) 
was introduced in terms of which QP became, for r = 1, 2,3 and 4, 
(47)* QP’ = kA*h,, ) 
(477)** Q°P" = kA¥-*{(k—1)hi—h,}, 
(4a) Q°P" = kA¥-%{(k—1) (k—2)h3—3(k—1) hyhg+hz} , (14) 


(4m) QtP WV = LARA — 1) (ke 2) (e—3) At — 6(e— 1) (k—2) Athy 
+ (k—1) (3h3 + 4h,hg) — hy}. 








Expressions for a), 2, and a, are 


wo (f24) 


a, = $k(}m)-# [{(k—1) h3—h,} A*-2—h, A*], 
a, = gg(3Q*Piv eas 2Q3P”) tes la,. 


(15) 





v 
wo 





(13) 


(14) 


(15) 
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It was decided to limit the values of k to < 10. Using the British Association Mathematical 
Tables, values of A*, h,, ha, hy and h, were calculated to six decimal accuracy in the range 
1-6 (0-2) 6-6 for Q. Values of ay, a, and a, were then obtained and all the calculations checked 
by fifth order differencing on the National Accounting Machine. 

The method used to obtain a, was to express it in terms of a,, a, and their derivatives 
Gy @z and a3. Thus ag = dy Q*a3— $8 Qa; + $a, + sy(Qay — 4a,). (16) 

The values of aj, a, and a3 were obtained by numerical differentiation, which gave the 
final values of a, to two decimal accuracy; this was ample for our purpose. An independent 


check was provided for a few test values, taking k = 2. For obtaining these values, P!v, Pv 
and Pvi were calculated and substituted in the formula 


ds = 3ga(Q°P¥! + OP + 11Q*P') — $a, — 330, (17) 
and compared with those obtained with the help of (16). The comparison is set out in Table 1. 
The agreement is satisfactory for our purpose. 


Table 1. Values of a, 


























Q Formula (16) Formula (17) 
2-2 1-8190 1-8242 
2-4 2-3353 2-3350 
2-6 2-3178 2-3176 
2-8 1-7453 1-7449 
3-0 0-7801 0-7799 





A further short-cut was used in calculating a,. Instead of using (16) for each value of k 
ranging from 2 to 10, a, was first calculated for k = 2,6 and 10. By three-point interpolation 
between them, values of a, were obtained for the remaining values of k. 

Although a, was not used in the evaluation of ,P,(Q), a few of its values were calculated 
by numerical differentiation of a, and a, using the formula 





Oy = zhzQtay — Hee Q'ag + HhoeO"a2 — rep z0 00s — vi522t 3$$5(Qa; — 4a,). (18) 


These values are presented in Table 2. 


Table 2. Values of a, 




















> 
k 
Q 4 2 6 10 
| SA 
2-8 + 2-5 + Ol — 60-0 
3-6 + 12-0 + 50-0 + 108-9 
| 4-4 — 61 —18-1 — 28-1 





The contribution from a, to the probability integral may be as large as 0-01 near the 
upper 5 and 1 % points if k = 10, v = 10. This will affect the percentage point of the largest 
variance ratio by as much as | in the unit’s place. If v = 20, only the first decimal will be 
affected by about 1 or 2. It is likely in practice that pv will be of the order of 20 or more when 
k = 10, so that the table will not vitiate the level of significance to any serious extent. 
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The values of v selected for constructing the tables of the upper 5 and 1 % points of F, 
were 10, 12, 15, 20, 30, 60 and oo to facilitate harmonic interpolation inside this range. 
Second-difference inverse interpolation was used to obtain the percentage points from the 
table of probability integrals. 

Table 3 shows the final results giving the upper 5 and 1 % points for k = 1 to 10. The 
values for k = 1 were copied from Merrington & Thompson’s (1943) tables, and the difference 
between these and the kth column (£ > 1) shows how much out we might be in assessing the 
significance of each variance ratio singly, rather than as one value in a group of k. Each row 
and column of the percentage points in Table 3 were differenced to the third order as a final 
check. No suspicious-looking values were found. 


Table 3. Upper per cent points of the largest variance ratio* 


5 % points 























N | | | | 
\k eee mee Pe a | LY a ee ee, ee | 
, | | | | 
ra PP Lg en ee ee ee 
10 4:96 | 679 | 8-00 | 96 | 978 | 10-52 | 11-18 | 11-79 | 12-36 | 12-87 
12 | 475 | 6-44 | 7:53 8-37 | 9-06 | 968 | 10-20 | 10-68 | 11-12 11-53 
15 4:54 | 612 | 711 | 7-86 | 8-47 | 898 | 9-43 9-82 | 10:19 | 10-52 
20 | 4:35 5-81 6-72 7-40 7-94 | 8-39 | 879 | 9-13 | 9-44 9-71 
30 | 4:17 | 5-52 6-36 | 6-97 | 7-46 | 7-87 | g-21 | 851 | 879 9-03 
60 | 4-00 5-25 6-02 6-58 7-02 | 7-38 7-68 | 7:96 | 820 | 8-41 
20 | 3-84 5-00 5-70 | 6-21 | 6-60 | 6-92 | 7-20 | 7:44 7-65 | 7-84 
| | | 
1 % points 
I\ k | | | | 
— sk a. ft = . 8 9 | 10 
v\| | 
~ | | : | | 
pele Te, ee ee ers i es a a as | og ell 
10 | 10:04 | 13-17 15-08 16-43 | 17-43 | 18-25 | 18-91 | 19-48 | 19-97 | 20-41 
12 | 9-33 | 11-88 13-52 | 14-73 | 15-69 16-47 17-12 17-68 18-16 | 18-60 
15 8-68 | 10-82 12-18 | 13-21 | 14-03 14-72 15-30 15-81 16-26 | 16-66 
20 8-10 9-93 11-08 11-93 12-61 | 13:19 | 13-67 | 14-09 14-49 | 14-83 
30 7-56 | 9-16 | 10-14 10-86 11-43 | 11-90 12-31 | 12-66 12-97 | 13-26 
60 7-08 | 849 | 934 | 9-95 | 10:43 | 10-82 11-15 | 11-45 11-72 | 11-95 
| 10 | 6-63 | 7-88 a5 8-61 915 | 954 | 9-87 10-16 | 10-41 | 10-62 | 10-82 
| } | | | 
— — -_ on 


EE - - — 


SSS eee 


* kis the number it idlaeeaiaais variance estimates, each based on 1 degree of freedom 


. v denotes the 
degrees of freedom of the independent ‘error’ variance. 


4. An illustration 
A good example to illustrate a possible application of Table 3 is provided in Wishart’s 
(1938) paper. He analysed the data (number of sticks) of a uniformity trial on asparagus 
as if it were an experiment with nitrate (N), phosphate (P) and potash (K) at two levels 
each, in eight blocks of four plots confounding the three-factor interaction between blocks. 
The analysis of variance is set out in Table 4. 


t+ The purpose of this preliminary trial was to collect material for adjustment, by the covariance 
technique, of inherent fertility differences among the plots when the N, P, K treatments were given in 
the ensuing season, 


— 
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Wishart writes: ‘The mean square for total “‘treatments” (6D.F.) is not significant, but 
on examination of the separate effects it would appear that the PK interaction is significant 
at the 5 % level [F.o; = 4:41, as against the observed F = 7-02.] With many ordinary experi- 
ments we should be happy to claim such a result as indicating a real effect.... But since the 
treatments were not applied, the effect is entirely accidental.’ 

He then applies Bartlett’s test for homogeneity of variance (which in this case is equivalent 
to the Neyman-Pearson L, test) on the six treatment variances and finds that ‘the set of 
mean squares is compatible with the hypothesis that it is homogeneous, and awkward 
explanations are avoided’. 

D. J. Bishop & U.S. Nair (1939) found that Bartlett’s test underestimates the significance 
if the degrees of freedom of some of the k variances are as small as 1 or 2. The 5 &% point of 
L, which they give when k = 6 and v = 1 is 0-094 against Bartlett’s value of 0-077. The 
value of L, for the present example is 0-152. It is not significant,* even by the exact L,-test 
of Bishop & Nair. 


Table 4. Analysis of variance 

















| 
ae Degrees of Mean square Variance 
Variation freedom Paes ratio (F) 
| 
Blocks 7 6543-2 — 
N 1 488-3 0-35 
3 1 69-0 0-05 
K 1 34-0 0-02 
NP 1 830-3 0-60 
NK l 57-8 0-04 
PK 1 9765-0 7-02 
(Total treatments) | (6) (1874-1) — 
Error | 18 1391-2 ooo 
= | 











Since only one of the six variances is standing out prominently, Cochran’s (1941) test 
based on g, the ratio of the largest variance divided by the sum of the set of variances may 
appeal as more appropriate than the L,-test. The value of g for the six treatment variances 
of Table 4 is 0-87. The 5 % value of g given in Cochran’s table is 0-78. According to the g-test, 
therefore, the variance for interaction PK is significantly large, making us reject a hypothesis, 
which we know to be true. 

To decide which of the two tests will be more appropriate in a situation where the hetero- 
geneity among the k variances is caused by the presence of a single variance much larger 
than the rest, would need a study of the power functions of the two tests for this particular 
class of alternative hypotheses, using the Neyman-Pearson theory. 

In the present example, however, neither the Z, nor the g-test takes into account the 
estimated ‘error’ variance with the help of which it has been possible to say that the total 
treatment effects (6D.F.) were not significant. The question now to be answered is whether 
the variance due to interaction PK, being the largest of the six individual treatment effects, 
could be considered as significantly greater than the error variance. The variance ratio for 
PK is 7-02. The 5 % point in Table 3 for k = 6, v = 18 is 8-59. The observed largest variance 
ratio is, therefore, not significantly large at the 5 % level. 


* For Z,, significance is indicated by low, not high, values. 
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5. Probability integral of the smallest variance ratio 
Let ,p,(q) denote the probability that s,/s, is >q. The probability that the smallest variance 
ratio F, is >q? will also be given by ,p,(q). 
Finney (1941) showed that »Px(q) = (1—_M)E(14A)-», (19) 


where M is as defined in (2) except for a replacement of Q by q; and A is to be put equal to 
zero after differentiation. 


Using Hartley’s general studentized integral 
»yPx(Q) = 20(3v) ay 0 89 1 e-#* p,.(q8q) dq, (20) 


where PA) = (2ram)- (Jami [am e—amet ax) . (21) 
q 


Finney remarks: “The convergence of the series by which significance levels for the 
smallest variance ratio are obtained is much more rapid than for the largest ratio. Also, as 
Hartley has demonstrated, the approximation given by an assumption of independence is 
very close even for small numbers of degrees of freedom.’ 

These remarks could easily be substantiated when m = 2 for which the exact value of 
,»P,{q) obtained from either (19) or (20) is 


2 2\ —iy 
(. + at) | (22) 
Vv 
On the assumption of independence as in (4), the approximate value for ,p;,(q) will be 
2 2\ —tky 
(: + =<) (23) 


Evidently (22) and (23) are not identical,* but when q is small and p is not too small, they 
will be very close to each other. 

As we are concerned with the lower percentage points of the smailest variance ratio, q 
will be small and hence approximation (4) should yield sufficiently accurate results for any m. 

We may, however, examine this more closely for the case m = 1. The exact value of 
yP;(q) can be obtained using the expansion (6) of Part I. Owing to the smallness of gq, it is 
scarcely necessary to add terms beyond a,. We may, however, include a, which is approxi- 
mately equal to —a,/8. The a, and a, terms are calculated from the formulae 


ay = Pala) = ( JzI “etde) = (1-2), (24) 


a, = k(gz) (1—a)*-* {(k— 1) gz + $(q? + 1) (1—@)}, (25) 


where a and z are quantities given in Table 2 of the T'ables for Statisticians and Biometricians, 
Part I. y 


In Table 5, values of a, and a, are calculated for q in the range 0 to 0-1 at intervals of 0-01 
and for k = 1 to 10. The probability that the smallest of & variance ratios, F, is <q? will 


be given by a, 
1—,px(a) = [1-4-9 (1-5), (26) 


* Finney claims in equation (21) of his paper thet they are identical, obviously by oversight. 
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Table 5. Table for calculating the probability integral of the smallest variance ratio* 
k 2 3 + 
? q 
ao a, 7) a, ao a, 
0-00 1-000 000 0-000 00 1-000 000 0-000 00 1-000 000 0-000 00 
0-01 0-984 106 0-003 99 0-976 254 0-005 98 0-968 465 0-007 98 
0-02 0-968 341 0-007 98 0-952 890 0-011 97 Q-937 685 0-015 95 
0-03 0-952 707 0-011 97 0-929 906 0-017 95 0-907 650 0-023 90 
t 0-04 0-937 204 0-015 97 0-907 301 0-023 93 0-878 352 0-031 84 
0-05 0-921 835 0-019 97 0-885 074 0-029 90 0-849 780 0-039 74 
0-06 0-906 600 0-023 97 0-863 225 0-035 87 0-821 924 0-047 61 
0-07 0-891 502 0-027 98 0-841 750 0-041 83 0-794 775 0-055 43 
0-08 0-876 540 0-032 00 0-820 649 0-047 78 0-768 323 0-063 20 
0-09 0-861 717 0-036 02 0-799 921 0-053 72 0-742 556 0-070 90 
0-10 0-847 034 0-040 05 0-779 563 0-059 64 0-717 466 0-078 53 
k 5 6 7 
q 
v7) a, 7) a, 7) a 
i 0-00 1-000 000 0-000 00 1-000 000 0-000 00 1-000 000 0-000 00 
0-01 0-960 738 0-009 97 0-953 072 0-011 96 0-945 468 0-013 95 
0-02 0-922 723 0-019 92 0-907 999 0-023 88 0-893 511 0-027 83 
0-03 0-885 927 0-029 83 0-864 725 0-035 72 0-844 029 0-041 56 
0-04 0-850 327 0-039 68 0-823 196 0-047 44 0-796 930 0-055 09 
0-05 0-815 893 0-049 46 0-783 357 0-059 00 0-752 118 0-068 36 
0-06 0-782 600 0-059 13 0-745 157 0-070 38 0-709 505 6-081 30 
0-07 0-750 421 0-068 69 0-708 543 0-081 53 0-669 002 0-093 88 
0-08 0-719 332 0-078 11 0-673 465 0-092 42 0-630 523 0-106 05 
0-09 0-689 306 0-087 38 0-639 874 0-103 03 0-593 986 0-117 76 
\ 0-10 0-660 316 0-096 48 0-607 718 0-113 34 0-559 310 0-128 98 
8 9 10 
k 
q 
ao a, ao a, ay a 
0-00 1-000 000 0-000 00 1-000 000 0-000 00 1-000 000 0-000 00 
0-01 0-937 924 0-015 94 0-930 440 0-017 92 0-923 017 0-019 90 
0-02 0-879 253 0-031 76 0-865 223 0-035 67 0-851 417 0-039 56 
0-03 0-823 829 0-047 35 0-804 112 0-053 09 0-784 867 0-058 75 
0-04 0-771 503 0-062 63 0-746 886 0-070 03 0-723 056 0-077 29 
0-05 0-722 126 0-077 50 0-693 329 0-086 39 0-665 681 0-095 03 
0-06 0-675 559 0-091 88 0-643 237 0-102 06 0-612 462 0-111 83 
0-07 0-631 667 0-105 70 0-596 416 0-116 95 0-563 132 0-127 60 
0-08 0-590 320 0-118 92 0-652 679 0-131 00 0-517 439 0-142 25 
0-09 0-551 390 0-131 47 0-511 848 0-144 14 0-475 142 0-155 72 
0-10 0-514 758 0-143 32 0-473 755 | 0-156 32 0-436 017 0-167 97 














* 1—,p.(q) = 1-a,—“ (a -5.). see equation (26). 
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which can be calculated with the help of Table 5 for any given qg, k and v. If this probability 
is less than 0-05 or 0-01, the observed smallest variance ratio q? can be said to be significantly 
small at the 5 or 1 % level respectively. 

The values of ,p;,(q) given by Table 5 have been compared in Table 6 with those obtained 
by the approximate formula (4), for vy = 10, g = 0-10 and 0-01. 


Table 6. Comparison of exact and approximate values of the 
probability integrals* of the smallest variance ratio 





























| 
q = 0-10 q= 0-01 

k 
10Px(@) {1071(9)}* 10Px() {1071(g)}* 
1 0-922 324 0-922 321 0-992 218 0-992 218 
2 0-850 989 0-850 676 0-984 500 0-984 497 
3 0-785 452 0-784 596 0-976 845 0-976 836 
4 0-725 221 0-723 649 0-969 253 0-969 234 
5 0-669 843 0-667 437 0-961 722 0-961 691 
6 | 0-618 911 0-615 591 0-954 253 0-954 207 
7 0-572 047 0-567 773 0-946 845 0-946 781 
8 0-528 911 0-523 669 0-939 498 0-939 413 
9 0-489 191 0-482 990 0-932 210 0-932 102 
10 0-452 604 0-445 472 | 0-924 982 | 0-924 848 

| 





There is satisfactory agreement between the two methods. Indeed, as is to be expected, 
the agreement is much better for q = 0-01 than for g = 0-10. The difference in the top row 
values in columns (2) and (3) is due to calculating the latter up to the term in v~ using the 
incomplete beta-function expansion (10) of Part I. It will be seen that for this expansion, 
terms up to v~ give a five decimal accuracy when q = 0-10 and this improves to six decimals 
when q = 0-01. 

We may, before concluding, add an illustration for the use of the test of the smallest 
variance ratio. This is also taken from Wishart’s (1938) paper, where by the ordinary test 
of significance he gets variance for an interaction NP as significantly less than the error 
variance. He calls this a ‘negative interaction’. Applying Bartlett’s test, Wishart found that 
this ‘negative’ interaction was not significant. The values concerned are s? = 0-01, 83 = 5-57, 
k = 6, m = 1, v= 18. To apply the test for significance of the smallest variance ratio, we 
calculate F, = pe = 0-0018 giving q = 0-04. Using (26) and referring to Table 5, we get 

1sP¢(0°04) = ay +a,(1—8/v)/v = 0-8258. 


The probability that F, is less than or equal to the observed value is about 0-17, which is 
much greater than 0-05. The observed F, is therefore not significantly small. 


In conclusion, I should like to acknowledge warmly the help and guidance I have received 
from Prof. E. 8. Pearson and Dr H. O. Hartley in the course of my investigations. 


* The probability integral is calculated here from g to 00, instead of the usual limits 0 to q. 
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THE ESTIMATION OF NON-LINEAR PARAMETERS BY 
‘INTERNAL LEAST SQUARES’ 


By H. 0. HARTLEY 


1. INTRODUCTION 


(1-1) The difficulties arising with curvilinear regressions 
In statistical regression of two variables y and 2, the linear relation y = a+ bx has received 
most attention. Apart from occasional ‘fitting of polynomials’, non-linear relations have not 
been used frequently. As reasons for the reluctance on the part of statistical workers to use 
non-linear regressions we may mention here: 


(a) The complication in the computational procedure when estimating non-linear para- 
meters by efficient methods such as least squares. 


(6) The lack of exactness in tests of the goodness of fit and the difficulty of establishing 
the random sampling distribution of fitted statistics. 

(c) The fact that any transformations to linearity such as f(y) = bg(x) +a (which may be 
suggested by theory), usually involve certain unknown parameters in f and g which must 
be estimated frora the sample and, therefore, bring in difficulties of type (6). 


(d) The difficulty of deciding which of the many possible non-linear regressions is 
suggested by theory. 


As examples illustrating these difficulties we may mention here: 


(a) The iterative process in dosage mortality technique which necessitates the preparation 
of special auxiliary tables for each fitted law. 

(b) Methods of fitting the Gompertz curve by factorial moments (Sasuly, 1934) resulting 
in procedures of unknown efficiency. 

(c) The exponential law of diminishing returns: 


y = 9(1—e*) (1) 
can be transformed to a linear relation between log, (1 —y/) and z: 
log, (1—y/9) = ke. (1’) 


However, a knowledge of the ‘limiting response’ 9 is usually required in order to make this 
transformation to linearity. If 9 is assessed by ‘inspection’ the accuracy of the subsequent 
fit of k cannot be ascertained, let alone the accuracy of the assessment of 9. 

(d) In numerous applications polynomial regressions have been fitted without a biological 
or social theory to guide the fit and, as a result, difficulties have been encountered in inter- 
preting the real meaning of the polynomial terms. 


(1-2) The principle of ‘internal regression’ 
The principle here adopted is that of bringing most of the important regression laws under 
one generating principle: Most of the laws in physics and technology are generated by simple, 
mainly linear, relationships, between the function and its first and second derivative (e.g. 


velocity and acceleration) and the same applies to most of the important laws in the bio- 
logical sciences. We may name two examples: 


t 


10¢ 


ing 


(1) 


(1’) 
this 
ent 


ical 
ter- 


der 
ple, 
e.g. 
bio- 


H. O. Hartiey 33 


(A) The exponential law mentioned above is generated by the first order differential 
equation dy 
7. = hp +hy, (2) 


which is a linear relationship. If applied to fertilizer response in agriculture (k < 0), this has 
the simple meaning that the additional yield, dy, caused by an addition of fertilizer dz, is, 
in the first place, proportional to dx (i.e. = 9(—k)dx); but this constant rate of increase 
(9(—)) is retarded by an amount (—(—)y) which in turn is proportional to the yield y 
already attained. 

(B) The ‘trade cycle’ for, say, a production index y is sometimes regarded as being caused 
by the interplay of production y and demand z which are assumed to satisfy the relations 


dy dz 
ye az, tes — py, 


tog d*y 
resulting in qe —apy (3) 
of which the general solution is the trade cycle law: 
y = sin[/(aA)t+y). (4) 


The idea, now, is to fit directly to the data the generating linear law (such as (2) or (3)) 
resulting in linear equations for the parameter estimates, rather than fitting the non-linear 
regressions (such as (1) or (4)). However, some modications are required: whilst for a mathe- 
matical function y(x) the regression (1) and the differential equation (2) are identical con- 
ditions, it would be difficult to fit to an empirical series of observed y; a condition involving 
its differential coefficient. We therefore seek a finite difference equivalent to the differential 
equation (2). As is well known (see, for example, Bartlett, 1946; Cunningham & Hynd, 1946; 
Kendall, 1944) the first order linear difference equation of the form 


Y¥i—Yi-a = by; +a (5) 
is capable of generating exactly the exponential law of type (1). Integrating (or summing) 
(5) we obtain y; = bY, +ax,+0, (6) 


j 
where Y; = > y;. Now this equation may be regarded as a linear regression equation for the 
i= 


dependent variable y; with its own progressive sum Y; as independent variable, and with x; 
playing the part of a second independent variable. Formally, therefore, the non-linear 
parameters 9 and k of (1) can be estimated from the simple linear regression coefficients 
a, b, c given in (6). 

In a similar manner the second order differential equation (3) can be replaced by a linear 
relation between y; and its second sum, ,Y; -3 DY and such a relation can be shown to be 
equivalent to the harmonic regression law (trade cycle) (4). The period ,/(a) of this trade 
cycle can therefore be determined as a partial linear regression coefficient between y; and 4Y;. 

Turning now to the general case, we shall call any regression equation in which the 
dependent variate y is related to its own repeated sums 


j ~ £8 
Y= lw W%= Tuy (7) 
imo 1=0i=0 


+ In §(2-1) we shall give the exact relation between the parameters yp, k and a, b, c. 
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etc., as independent vari es, an ‘Internal regression’. This concept is, of course, closely 
linked with that of auto-regression in time series. Its usefulness lies in its close relation to 
linear differential equations, which are known to generate most of the important regression 
laws and also give a better understanding of the physical or biological mechanism producing 
the respective curvilinear regression. 

The principle of estimation and goodness of fit that we shall use in conjunction with 
internal regression is that of least squares applied to the ‘integrated’ equation (6) and not 
to the corresponding difference equation (5) (see, for example, Bartlett, 1946; Mann & 
Wald, 1943). This method is, at first, accepted as a working rule and the formulae for the 
estimators derived and demonstrated in terms of examples. Only the first order internal 
regression is treated here (§2). The efficiency of the estimator is then considered under 
various assumptions of residual independence. In particular, the classical assumption of 
random residuals attached to the observed y; is fully investigated by comparing the efficiency 
of our estimators with the 100 % efficient transcendental maximum likelihood roots. To 
this end, large sample formulae for the variances of the estimators will be developed (§ 3), 
leaving the derivation of exact sampling distributions for goodness of fit tests to a later paper. 


2. THE PROCEDURE OF INTERNAL REGRESSION 


(2-1) The first order internal regression; fitting of the exponential law 


Consider a sample of observed values y; corresponding to discrete integer positions, x; = i, 
of the independent variable x (e.g. a time series). If the y; satisfy exactly the difference 


si apa Yisr— Ys) = —P(Yiurty)t+e (8) 
then, by standard finite difference technique, they also satisfy exactly the exponential law 
¥; = (1 —fe™), (9) 

where the limiting response 9 and the ‘exponential curvature’ k are given by 
9=a/b; —k=2tanh—}b (10) 


whilst f is a constant of integration. In order to find the least square estimates for a and b 
it is convenient to distinguish two cases: 


(2-11) n=odd =2m+1 (¢=—m,—m+1,...,—1,0,1,..., m), 
(2-12) nm = even = 2m (ti =—™m, ..., —1, 1, ..., m). 
(2-11) We introduce = 
Y¥=(2m+1)* Ly M=H-Y && =?. (11) 
i=—m 
Hence uy, = XE, = 0. (12) 
We rewrite (8) as (Mixa — 91) = — 30(9441 +7) + (@— 59) (13) 


and sum the difference equation form i = 0 to i = j, introducing at the’same time as a new 
variable S; the first sum of the 7; as follows: 


wR 
| 


jut 

5= 3+ z+ 39; for j21, 
j+1 . 

8;= ~~ SM for j<—1. 
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The progressive sums of (13) are then found to be equivalent to the equations: 


13-9 = —58;+ (a—by) E;+¢, (15) 
or 9; = —6S;+a’E;+¢’, (16) 
where a’ =a—by, 
or a’ |b = yo—¥ (17) 


and c, c’ are constants of summation. 
The least square solutions for a’, —b and c’ are then given by: 


— b= S? +a’X8; gE; +cXS; _ XS; Ni» 
—bzrS;E;+a’=B d Pe =0;£i, (18) 
=— bxS; + c'n => 0. 


It is now easy to see from the definition of the S; that they are exactly orthogonal to the 
7; 1.e. that 


E Sin = 0. (19) 
i=—m 
Using (19), subtracting the last equation in (18) from the first two and solving for —6 and 
<aeen —b = AUB £E,E8,E), a’ = A(E(S,-5P Ey, £,), (20) 
where A = X(S,;—8)? Dé —(=S,é,)?, S = nds, 
and the summation is extended from i = —m to t = m throughout. For practical use the 


formulae (20) must be further simplified; in particular, we wish to avoid the calculation of 
the deviates 7;. We therefore introduce sum values formed directly from the y; 
3 


j—1 
Ys= Mot Xytty; for j21, 
i=1 


i= 


Y= 0, 
F j+1 (21) 
Y; = —440- = Ms for j<-—l, 
a = Ly; 
and note the following relationships: 
XE, S; = — $20, 3, (22) 
X(S;— 8)? = DY?+ YnEy,83— Y2nDE? —n-(TY,)?. (23) 


With the help of these relations we reach the following working formulae for the estimators 
a’, —b and c’ in the order of computation. From data calculate Y;, XY; and Y (see (21)), 


Ly,é; Dy é?, UY, DE? = 4m(m+1)(2m+1). 
Compute 29, &? = Dy, é? — Yn-128}, 
X(S;— 8)? from (23), 
A = DE2(S—5)*— Hm, 8)%| 
a’ = A Dy £2(S—S)*, 
—b = fA-tdy E29; G3, 
ce’ = n—“"bxyY,. J 


(25) 
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Finally, we note the relation between the estimators a’, —b and c’ and the parameters 
of the original exponential law, i.e. the limiting response 9, the exponential curvature k 
and f, Wehave 9 —a'Jbin7Y, f=a'/b—c', k=—2tanh}p. (26) 
As an illustration and check of these formulae we apply them in example | below to the 


theoretical sequence y; = 1 — e~*i, x; = 0(1)4. The table below is self explanatory, the worl 
following the computational order of equations (25). 


Example 1. Theoretical series y, = 1—e~; estimation of parameters by internal least square 





























vg % 2Y, (from (21)) &; 3) 
0 0-000 ‘ — 2-129 —3 4 
1 0-632 — 1-497 = | 1 
2 0-865 0 0 0 
3 0-950 1-815 1 1 
4 0-982 3-747 2 4 
Y = 3-429 1-936 = 25 Y, 
Zy,é;= 2-282, xe? = 10, XY? = 6-0270, 
Ly,g2= 5-510, 
=, £3 = —1-350, X(S8,—S)?= 0-2119, A = 1-665, 
a’= 0-290, b= 0-925, c’ = 0-179, 
9= 1-000, k = — 1-000, f9 = 0-135 = e. 


The true values of the parameters are, of course, exactly reproduced. 


(2-12) The case n = even = 2m 
The only modifications of the previous section consist in defining 


&:=(2i-—1) for i=1,...,m; &,=34(2t+1) for «+=—-1,...,-—m (27) 


j-1 
and ¥;= Dy¥sthy; for j2>1, 
se 28) 
i 7 
Yy=- 2 uy for j<-—l, 


and similarly for the S;. All other definitions, formulae and results are the same as for odd n 
except that the summations are from i = —m to —1 and from +1 to +m, omitting 0. 
Below we illustrate the procedure by fitting the exponential law of diminishing returns 
to yield data obtained in manurial trials of the National Agricultural Research Bureau, 
China.{ Both trials give the response of a number of wheat varieties to the application of 
sulphate of ammonia at the rates of 4, 8, 12, 16 and 20c./m.{ The responses are grain yields 
and we confine ourselves here to the mean varietal responses. In the first experiment 
(example 2) it will be seen that there is a marked retardation of the response to the higher 


{ The data were kindly put at my disposal by Dr H. L. Richardson of the Imperial Chemical In- 


dustries Ltd. Many authors have applied the exponential law to the analysis of fertilizer trials (sec. 
for example, Crowther & Yates (1941)). 


} c./m. = cattys per mou, the Chinese measure of yield and rate of fertilizer application. 
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rs fertilizer rates. In the second experiment (example 3), there is hardly any retardation and 
Kk the estimate of the limiting response is, consequently, very high. The fit is illustrated in 
6) Figs. 1 and 2. 
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limiting response, 9 = 530 c/m. 
Fig. 1. Wheat yield; response to rate of fertilizer (example 2). 
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1 of limiting response, 7 = 1786 c/m. 
wn Fig. 2. Wheat yield; response to rate of fertilizer (example 3). 
en 
par Normally one would, of course, require more than six observations for fitting a three 
| In- parameter .regression. However, the estimation of exponential curvature and limiting 
(see. response in short series is akin to the calculation of the ‘quadratic effect’ customary in 


fertilizer trials with only three levels, 
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Example 2. N-fertilizer trial with wheat, Hopen, Tinghsien, 1936. Fit of exponential 
law of diminishing returns to mean varietal responses 





























Fertilizer : 
: y; = 10x yield 2Y, 26, 4gj 
rate in c./m. . 1500 . . : 
0 127 — 1187 —5 25 
4 151 — 909 —3 9 
8 379 — 379 -1 r 
12 421 421 1 1 
16 460 1302 3 9 
20. 426 2188 5 25 
Y = 1964 1436 Check:} 1436 = 6(1307 — 657) — 2(1232) 
Y-= 657* 
Y+ = 1307 
Ly,é,= 1232, xé2= 17-5, DY? = 225 9670, 
tyiE3= 5031, LY, = 718, 
=, £3 = —697, X(S,—S)?= 70524, A = 111 2718, 
a’= 1781, b = +0386, c’ = 462, 
9= 530, k = —0-391, Of = 156. 


Fitted law: 


y;, = 529-6 — 156-1 exp (—0-3914,). 


Example 3. N -fertilizer trial with wheat, Shantung, 1936. Fit of exponential 
law of diminishing returns to mean varietal responses 





























Fertilizer Response 
rate in c./m. y; = 10 yield 2Y, 2g, 4g? 
— 3000 
0 353 — 3179 -—65 25 
4 627 — 2199 -—3 9 
8 786 — 786 -1 1 
12 717 717 1 1 
16 959 2393 3 9 
20 1093 4445 5 25 
Y = 4535 1391 Check: 1391 = 6(2769— 1766) — 2(2313-5) 
Y- = 1766 
Y*+ = 2769 
Ly,é;= 2313-5, Lez = 1755, XY? = 103 89 500, 
Ly,£2= 12982, XY, = 695-5, 
=, £2 = — 245, X(S;—S)? = .126230, A = 219 4019, 
a’= 133, b= 0:1292, c’ = 15-0, 
g9= 1786, k = —0-1294, Of = 1015. 


Fitted law: 


t It is convenient, when adding the y;, to record Y- = Ly, fori<0 and Y*+ = Ly; for i> 0, separately 
(fornung Y = Y~+ Y+ = Xy,). This provides a check on the forming and copying of the Y, from the 


y; = 1786— 1015 exp (—0-1294¢,). 


equation Z2Y,; = n(Y+— Y~-)—22y;&;,, e.g. in the present case 6(1307 — 657) — 2(1232) = 1436. 
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We now turn to two well-known regression laws which, by suitable transformation, can 
be reduced to our exponential law. 


(2-2) The internal least square fit of the logistic curve 
The general form of the logistic curve ist 
z= Aj(1+ Be-**). (29) 
In the case where A is known (as for instance with a biological response known to vary 
between 0 and 100 %) the transformation 
log (A/z—1) = log B— ka, (30) 
reduces the problem to a plain linear regression fit for log B and k. Nevertheless, this case 
has recently been dealt with (Finney, 1947) by the more elaborate, but under certain con- 
ditions more efficient, method of maximum likelihood. 
We are here dealing with the general case where A has to be estimated from the data. 
In this case the transformation z = 1/y yields 
y = 1/A+(B/A)e*, (31) 
which is of the form (1) or (9). Considerations of appropriateness and efficiency are, again, 
postponed for discussion in §3 below, but we should mention here that Rhodes (1940) also 
uses reciprocals when fitting the logistic by a different method. We are giving in example 4, 
below, the data used by him, viz. Population figures for the U.S. Census Data, 1800-1910. 


It is with such data on population growth that the estimation of the logistic parameters is 
of importance. 


Example 4. U.S. Census population 1800-1910. Fit of logistic curve and 
estimation of its parameters by internal least squares 
































‘Wien Population 
* (millions) y = 10,000/z 2Y, 2g; 42? 
z 

1800 5-308 1884 — 10310 -11 121 
10 7-240 1381 — 7045 -— 9 81 
20 9-638 1038 — 4626 — 7 49 
30 12-866 777 — 2811 -— 5 25 
40 17-069 586 — 1448 -— 3 9 
1850 23-192 431 — 431 - 1 1 
60 31-443 318 318 1 1 
70 38-558 259 895 3 9 
80 50-156 199 1353 5 25 
90 62-948 159 i711 7 49 
1900 75-995 132 2002 9 81 
10 91-972 109 2243 il 121 

Y =7273 

Y- = 6097 

Y+ = 1176 


+ In some applications it has been found necessary to generalize the logistic to 
y—C = A/(1+B exp (—2)), 


where the lower asymptote C is a fourth parameter to be estimated from the sample. However, this 
case is comparatively rare. 
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Following the formulae and procedure (25), we obtain 
a’ =—172:15, b= 0-3074, 

whence 9= 50-4, = —0-3098, 


c' = — 232-46, 
f9 = — 323-4. 

By comparison with (31) we obtain from the above parameter estimates of the exponential 
law, the corresponding-estimates for the logistic. These are given below, alongside those 
obtained by Rhodes, who used a method which is computationally more cumbersome as it 
requires both the reciprocal, as well as a logarithmic transformation. 


Example 4. U.S. Census data. Comparison of estimates of logistic parameters 
obtained by Rhodes with those obtained by internal regression 








P ind Internal Rhodes’ (1940) 
aaa regression method 
10,000/y 198 199 
—k 0-3098 0-3127 
—of 323 328 




















The agreement is extremely close, which is to be expected as the logistic curve fits the 
data well. In general, the theoretical properties of Rhodes’s method are difficult to assess 
as it consists of two fitting procedures. The first (whichis akin to a lag-1 autoregressive scheme) 
provides the estimates of k and A; these are then used to transform to linearity (as in (30)), 
so that the estimate of B/A is obtained as a mean of the log transforms. 


(2:3) The internal least square fit of the Makeham-Gompertz curve 
This curve is of fundamental importance in Life Table work. Its general form is 
z = aexp (—be-**)., (32) 


Using the transformation y = logz, we obtain 


y = loga— be-**, (33) 


which is of the form (1) or (9), so that its parameters can be estimated by the same method. 
We intend to deal with this application more fully elsewhere. 


(2-4) The special case of the exponential law with known asymptote (Markoff chain) 
A particular case of the first order linear difference equation is the case a 


= 0. In this 

case, (8) is equivalent to j.> —4(yi4,+Y,), (34) 
which is the systematic part of the tied chain equation 

Yin = MY TMs (35) 

in which vy; represents a random disturbance. In analogy to the general case, we have as 

the solution of (34) y, = yrer, (36) 

where k=-—2tanh}b, y* = 7. (37) 


Dealing with the case n = odd = 2m + 1, retaining the definitions (21), we find by summation 
of (34) ny = —bY;+, (38) 


ee TOT 


al 


he 
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where wis a constant of integration. Obviously (34) and (38) are, again, equivalent equations. 
The least square solutions for 6 and w in (38) are then given by 


From the second equation it follows that w = bn-?XY, and hence, from the first equation, that 
—b = XY,9,/2(¥,— Y)*. (40) 


By partial summation we may transform (40) into 


—b = n1Ey,£,2y,/X(¥,— ¥)*, 
which is our least square estimate of b. It is proportional to the mean of the y and to the 
regression coefficient y on x, whilst it is inversely proportional to the sum of squares of the 


progressive totals Y, of the y;, The computational procedure is simplified as &,£3? is no 
longer required. 


3. LARGE SAMPLE THEORY OF THE INTERNAL LEAST SQUARE ESTIMATORS 


(3-1) The relation between internal least square and ordinary least square estimates 
In this section we compare the basic assumption on which the internal least square method 
is based with that made in the ordinary least square hypothesis. We confine ourselves to 


the special case of an exponential law with x axis as asymptote, as in (36). The general case 
follows on the same lines. If we denote the residuals of (36) by ¢;, viz. 


6; = y,—y*e™, (41) 
then the assumption on which the classical least square fit is based, is that the ¢,; are in- 
dependent and have the same variance. The roots y* and k of, Xe? = minimum, are then 
maximum likelihood estimates. If on the other hand we assume that the residuals of (39), viz. 

& = 1% +5(¥,— ¥), (42) 
are independent and have the same variance, then the internal least square estimators have 
the maximum likelihood property. Yet another hypothesis can be investigated: 

Analogous to Bartlett’s (1946) treatment of stationary time series in correlogram work, 
we may consider the residuals : 
9; = (Yi — Ya) + HY + Hd) (43) 
in the difference equation (34). The assumption of independent deviates, @,, which is the 
analogue to Bartlett’s starting point, would lead in the present case to the estimator 


— 4 = (Yi, — x m)/ZYinr + ¥)*. (44) 

This is unsuitable, as its numerator depends on the first and last observation only. It is 
interesting to note the relation between the ¢; and ¢; of (41) and (42). We find: 

¢, = 6, +(E,—B), (45) 

where H; and £ are formed from the ¢; on the lines of (21). Since 6 is of the order n— and 

therefore small,} it follows that the second term in (45) is small compared with the first, 

particularly near the centre of the range j = 0. Thus the assumption of independent ¢; does 


not differ seriously from that of the classical least square method. It is unlikely, therefore, 
that many situations will arise in which the assumption of independent ¢; can be disproved 


+ It must be remembered that Y,, is a total of $n values of y; and hence, from (38), b~ 2y/ny. 
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whilst the hypothesis of independent e; can be accepted. Nevertheless, we give in the next 
section the loss in efficiency resulting from the use of the internal least-square-fit under the 
more usual hypothesis that the ¢; are independent deviates with equal variance. 


(3-2) The efficiency of the internal least square estimator 
In this section we confine ourselves to the case a = 0, i.e. the exponential law with 2 axis as 
asymptote. The treatment of the general first order internal regression is or. similar lines but 
algebraically more tedious. Further, in order to simplify the formulae we approximate 
+m 
exponential sums of the type h > e**i f(x;) with x,,,-—xz;=h and n = 2m+1, by the 


i=-—m 
integrals 


+4X 
| ek f(a) da, 
es 


with X = mh. The error thereby committed is small, provided m is moderate or large. 
The exact summations could be carried out, but are more tedious. 

We first derive the transcendental equations for the ordinary least square estimators and 
derive their variances from the general maximum likelihood formulae. We then derive an 
approximate large sample formula for the variance of the internal least square estimator b, 
and finally by comparison with the former, its efficiency. 


(3-21) Maximum likelihood results 
Let the range of the independent variate be —}X <x<4X; X = nh, and let us try to 
fit the expression y(x) = y*ek* (46) 


to the observed series y(x;) where x; = ih, h = X/n. Then, by ordinary least square or 
maximum likelihood procedure, we minimize 


+4X 
L=xX wi (y—y*e"*)* de, (47) 
iit 
resulting in the nonlinear system of equations 
+4X 
- X | 2 (y—y # ckz) ekz x y* dx = 0, 


font (48) 
By = X-1 } « (y— y* e*) ek dx = 0. 


In order to obtain the variance of the maximum likelihood estimator of k (k say) we must 


fora the Hessian r (* 1) P a-2 aeL ) 


|" 7B) Ok oy* 
(49) 
(sexs) si 
AI dkdy* ay) re 
We obtain 
rT $X—ly*k-{(2 +g?) (e*—e-%) — 2g(eX+e-%)}, 4X-lyk-*{q(et + e-%) — (e4-—e-%)} | (50) 
a | 4X —lyk-*{q(e2 + e-2) — (e¢@—e-4)}, 4X -1k-1(e4-e-*) | f 


where q = kX and k is the true parameter. Accordingly we find for the variance of k (which 
is given by the ratio of first minor to n times the determinant) 


Variance k = o2 8y*-2g3n-1X —2(e4 — e-2)/(4q? + (e7— e-)?), (51) 


& 


re YP 


—— 


ct 
1e 


1ust 


(49) 


(50) 


hich 


(51) 


& 
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which can be reduced to 
Variance k = o2 8y**g? n- X— sinh q/(cosh 2g — 2g?— 1). (52) 
Letting k>0, but keeping X fixed (i.e. letting g>0) we have 
Variance £->0? 12y*-2n-1X-2, (53) 
As an independent check on (53) we remember that for g>0 with y* large and fixed, the 
exponential law (46) will be approximately represented by the line 
y(x) = y* + y*ke. (54) 
The maximum likelihood estimator of y*k, that is the ordinary linear regression coefficient, 
has a variance o2/=(x;—%)* which, for the present sample of x; equidistantly spread over 
the interval of length X, tends to o212/(X2n), thereby confirming (53). 
(3-22) Internal least square results 


We now turn to the internal least square estimator 6 and study its random sampling 
distribution under the hypothesis that the observed values of y; have expectations 
y* exp (kx,), from which they differ by independent random deviates ¢; having equal variances 


viz. y(x,) = y* exp (kx,) +¢;. (55) 


r+4x 
We again use the approximation Xn—Zf(x;) = J f(x) dz. 
x 


Using elementary and partia! integration and putting kX = q, we reach the following 


results: of +4X P y*, : +4X ee 
= ‘eo = —(etd— e234 
Total of y e xl”) sient (e4#—e +f ve ‘ (56) 
y = X-" total of y = y*q-"(et4 — e442) + €; 
ger a as (57) 
where y = —y* (qk) (e#4— e749); 
Y(x) = io dx = yri-set + [edr; (58) 
0 0 
as z +4X fz 
Y-Y= yee ty+ | edz— x=] | edi dz; (59) 
0 -ixJ0 
43X os +3X +3X 
| (Y—Y)*dx = A+ 2B edx— 2 eC(x) dz; (60) 
—}X —}X ~+x 
where A = Sy**k-3(e4—e-4) —y2X, 
B = hy*k*(el + et), (61) 
and C(x) = y*k-*e* + ya, 
and where the quadratic term in ¢ has been ignored. Similarly we obtain: 
+4X +4X +4X 
} e¥dx = e(4+B] edz + | e(—O(z) + D(a))dz), (62) 
$x -4x -ix 
where D(x) = y*ke** + ky, 


and where, again, the quadratic term in e has been ignored. We now form our estimator b 


in accordance with (40): + 44x 44x ve 
-b=| n¥ae/ | (Y—Y)*dz, (63) 
—+xX —+X 
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and obtain to within linear terms in ¢é: 


ata H(t $421 <s B+ O(e) + Dia) da}, (64) 


We first note that to within the approximation employed the expectation of —6 is k, which 
is the first term in the expansion of —b = 2 tanh }k.t+ 


Next we see that we have a representation of --6 in the form constant + fe (x) da, i.e. a 
weighted sum of residuals. Remembering now that fetaz is being used as an approximation 
to $ f (x,;) €, and using, therefore, the formula 


+4X +4X 
Variance ( | we ef (x) az) = 02 Xn ie f?(x) dz, (65) 
we reach Variance b = oixna{"( — B+ C(x)+ D(x))* dz, (66) 
4x 
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Fig. 3. Comparison of the variance § of alternative estimators: 
(a) Maximum likelihood (equation 52) -------- 
(6) Internal least square (equation 67) — 





§ The variances are standardized by putting f= 1, X=1,s=1, y*= 


which, after some lengthy algebra, emerges as 


14 
4g? —1+ (7+) tanh a+ de coth 4g 


Variance (b) = a? 
— f = “tanh in) (et—e-*) 





(67) 


It is easy to see that for g>0, varb->120?/nX*y**, which is the same limit as (53) and 
therefore agrees with both the maximum likelihood value as well as the classical variance 
of the linear regression coefficient. 


+ For the order of discrepancy between —b and k see, for instance, examples 1 to 4 of Part 2. 
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(3-23) The efficiency of 6 

In Fig. 3 we have plotted both the maximum likelihood variance of & as well as that of b. 
For given values of 02, n, X and y*, both variances are functions of g = kX. We have already 
seen that for q-> 0 they tend to the same limit, so that b is highly efficient for small g,t which 
was to be expected from the discussion given in § (3-1). As q increases both variances decrease 
rapidly, but the maximum likelihood variance more so and the efficiency of b drops until 
for large q the efficiency tends to 600/q %. For such large values of g (say g>10), when the 
fitted exponential is steep and sharply bent and when y_,, > 10y,,, it is doubtful whether the 
basic assumption of uniform variance of the residuals ¢; over the whole range X is justified. 

The objection that the variance of b depends on q, i.e. the parameter estimated by — bX, 


can of course be overcome (at least approximately) by an appropriate variate transformation 
of 6. We shall not enter into this problem here. 
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THE GEOMETRICAL METHOD IN THE 
THEORY OF SAMPLING 


By DAVID FOG, den kgl. Veterinaer- og Landbohojskole, Copenhagen 


For the determination of exact sampling distributions a number of different methods have 
been employed, of which two will be mentioned here: 

(1) The geometrical method, which has been applied with great success especially by 
R. A. Fisher (1915, 1925) and consists in the use of the terminology and results of multi- 
dimensional geometry ; 

(2) the analytical method, the main line of which is a change of variables and calculation 
of the corresponding functional determinants. 

The first method appears elegant and short, whereas the second frequently leads to long 
calculations. On the other hand, the view is often expressed that the geometrical method 
arrives at its results too easily, at the cost of the accuracy usually required, and which is 
duly honoured by the analytical method. Probably this view has been affirmed by the 
circumstance that it has proved difficult to translate the geometrical methods and 
considerations so as to enter naturally and smoothly into the usual analytical treatment. 

With regard to the criticism that the geometrical method is less accurate, it should be 
observed that the justification depends entirely on the way in which the multidimensional 
geometry is built up. The construction of the multidimensional geometry may be worked out 
on a purely numerical basis, without introducing a single geometrical axiom, but in such a 
manner that the meaning of the geometrical terms as well as the contents of the geometrical 
formulae are of an entirely numerical nature. The system then rests on the same basis as 
the usual mathematical analysis and is therefore just as precise as the latter. 

This subject will not be discussed further here, but we shall show in the present paper 
how in a number of cases the geometrical method may, with complete preservation of its 
simplicity, be translated into analytical form, so that, without any knowledge of multi- 
dimensional geometry, advantage may be taken of the simple methods to which it has given 
rise. 

Before dealing with the examples we shall recall the concepts of volume and surface- 
content of an n-dimensional sphere. Such a sphere lies in an n-dimensional space and may 
be represented by the equation 

e+a3+...+22 =a’; (1) 
its interior is the domain vi+a3+...+22 <a’. (2) 


The volume of this domain is determined as the multiple integral 


V,,(a) -[ Tr [aeazy.. .dz,, (3) 


and it is easily shown that 
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In order to find the corresponding surface-content S,(a) we consider dV,(a). This denotes 
the volume between two concentric spheres of radii a and a+da; thus dV,(a) = S,(a)da. 
We therefore obtain dV,(a) 2mimar—4 


It should be noted that the result (4), even with exclusion of all geometry, has a definite 
meaning as the value of the multiple integral (3). As for (5), from a purely analytical 
point of view, we need only regard it in the following as a definition of S,,(a). 

We shall now consider three examples. The first two are quite elementary, and the results 
of all three are well known. Each example will be treated in two ways, in a geometrical and 
in an analytical manner, the latter being the translation of the former into analytical 
language; the essential points are the possibility of this translation and its method of 
working out. 

Example 1. Let x,,2%,,...,2, be m mutually independent variables, all normal (0,c), 
i.e. having the frequency function 


1 2 
Pix} = Jeno? [ - =| . (6) 


The frequency function of the set X = (x,, 9, ...,%,,) is then 





«= PX} = Taney? — a2 |- (7) 
Putting q= J 24) ; (8) 
i 
the formula (7) may also be written 
Me. SaaS. oe 
«= (amor ex At ©) 


Assuming X to be a point in an n-dimensional space and xk = p{X} to be the density at 
this point, the probability of X being in a domain w is equal to the mass of w and is given 
by the multiple integral 

J---[cax, (10) 
taken throughout w, where dX = dz,dz....dz,, is an element of volume. 

This in particular comprises the determination of the distribution of an arbitrary statistic 

¥ = P(X,, Xq, -.-, 2%). 
Designating its distribution function as P{y}, (10) gives d P{y}, when for w we put the domain 
Y <P(X4, Xe, ...,X_,)<yt+dy. 

We shall now find the distribution of the statistic g, introduced in (8). This variable may 
be interpreted as the distance from the origin O to the point X. Hence we use as element of 
volume the region between two n-dimensional spheres of common centre O and radii q 
and q+dq and obtain dP{q} = xdV,(q) = xS,(q)4q- 

Inserting the values of « and S,,(q) from (9) and (5) we get 


l ¢ q n-ldq 
dP{q} = sera? | — Ja (2) _ (11) 


and we have obtained the distribution required. For o = 1 (11) in particular shows the 
distribution of y. 
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Next we will prove (11) without any use of geometry, but following the exposition above 
as closely as possible. We then start with (9)—where q is determined by (8)—and 
ad P{X} = xdX. (12) 
By an almost* one-to-one correspondence we pass from the variables X = (x,,%2, ...,%,) to 
q, U = (Uy, Ug, ---,Up_y); 


the u’s being co-ordinates on the unit-sphere, the specification of which is of no importance 
for the proof.t Designating by A the jacobian 0(X)/0(q, U), we get 


dP{q, U} = x|A|dqdU, 


from which we find dP{q} = da ...[| A|dU, (13) 
w being the domain of the w’s. 


Hence it remains only to determine the multiple integral in (13), which is done as follows: 


From V,(a) = 


we obtain by means of the substitution used above 


va(a) = |...,||aaau = |"da) fla |av, 
thus by differentiation aV( a - |. f A|dU. 


Hence the integral desired is equal to n(7), and (13) becomes 
ad P{q} = KS, (q) dq, 
which, just as before, leads to (11). 


Note. The assumption that the true mean of z is 0 is of little importance. For if this mean 
is equal to 7 +0, we have only to consider, instead of x, the deviation x— from yw. We then 


find that n 
. | (Se-a) 


has the distribution (11). A similar modification will apply to the following examples. 


Example 2. As before, let X = (x, 2%, ...,%,,) be distributed so that (6) and (7) are valid. 
From the z’s we form the linear combination 


n 


z= )4,%,;, (14)° 
1 


where for the sake of convenience we may assume that 
n 
> a? = 1. (15) 
1 
* The exceptional points forming a domain of volume 0. 
+ A suitable transformation is for instance 
x, = q COs uy; (q>09), 


L_ = | SiN U, COS Uy (0<u,<7, t= 1, 2, ...,n—2), 


Ly_1 = 7 SN Uy, SIN Uy ... SIN Up_p COSU,z_» (O<U,_,< 27), 


Ly = Sin Uy, SIN Ug ... SIN Uy_, SIN Uy_}. 





~— 





ce 


3) 
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n 
In Fig. 1, a represents the hyperplane > a;z; = 0, passing through O; the line / is perpen- 
i 


dicular to a at O. The point X is projected on / and a as N and Q; the quadrilateral ONXQ 
is a rectangle. The co-ordinates of N and Q are easily found to be 


N = (@,2,...,4,2), Q = (2,—@,2, ...,%,—@,2). 
Further ON = z, and for OQ, denoted by q,, we find 


n 
Gi = & (x;—4,2)*. (16) 
1 
From the right-angled triangle OQX, where OX? = > x?, we have 
1 


Sa} = 22+q2, (17) 


which may also be easily verified directly by calculation. 





Fig. 1. 
By means of (17), we may write (7) as 


1 z* +9? 
= Gramare?| —“aet | Ore 
We will now find the joint distribution of z and g,. As element of volume for X we use 
a domain, the projection of which on @ is the region between two (n — 1)-dimensional spheres 


in a, having the common centre O and the radii g, and q, + dq,, and the projection of which 
on l is the line-element dz. We then get 





dP{z,q,} = KdV, _4(q,) dz = KS,,_,(q,) dq, dz. (19) 
Hence by (18) and (5) 
- 1 2 1 qi 1(9\"*4dq, 
aP{e, a} = Jens”? | sa |e ?| Zs oe ves 


Thus z and q, are independent; z is normal.(0,c), and q, is distributed as q in (11), but with 
n— 1 instead of n. 


nr 
If in particular a, = a, = ... = a, = 1/,/n, we get, Z being the mean > z;,/n, 
i 


‘ n 
z=ZJn, gi= ~ (x,—Z)*. 
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Let us now, without the aid of geometry, once more prove (20), starting from (6), (7), 
(14), (15) and ad P{X} = «dX. (21) 
We introduce new variables z, ¥Y = (y;, 2, ---; ¥Y,_1) by means of an orthogonal substitution 


Z = AX, + Aglgt ... 4,2, Ye = Ajy% + AgygXot...+a,,%, (t= 1,2,...,.n—1), (22) 


and put "= JQ > ‘a) ; (23) 
1 


As (22) leaves sums of squares invariant we get 
n 
ai = 274 q?. (24) 


A comparison with (17) shows that the q,’s introduced by (23) and (16) are identical. 
The jacobian corresponding to (22) being + 1 we get from (21) 
dP{z, Y} = xdzdY, (25) 
where as before x is determined by (18). 
By a transformation analogous to the one on p. 48, but with n—1 instead of n, we may 
instead of Y introduce new variables (q,, u, Uo, ...,U,—»). After integration relative to the 


u's we have dP{z,q,} = Kdz8,,_,(q,) dq, 


which is equivalent to (19) and immediately leads to (20). 

Example 3. As a final example we consider the normal correlation between k variables. 
In the geometrical treatment we use a method employed by Wishart (1928) for the derivation 
of the distribution named after him, with certain simplifications, however, which will 
facilitate the transition to the analytical exposition. Furthermore, for convenience, we 
assume in the following k = 3; the generalization from k = 3 to an arbitrary value should cause 
no difficulties, the addition of one more variable merely introducing another step of reduction. 

Let x, y, z denote three normally correlated variables. Assuming that the three true means 
are equal to 0, the frequency function may be written 

/ 


JA - 
p{x, y,z} = (on)! ,exp [— }(a,,2? + 2a, .7y + ... + @ggz*)], (26) 


where A is the determinant |a,,|. We consider n triples (x;, y;,2;), mutually independent 
and each satisfying (26). We introduce the designations 


n 


n n 
or t _ oa o7 
hi = Ba, Lie = Bei Vis sees log = 7. (27) 


Putting furthermore in the same way as before 


KX = (X4,%q, ..-5Sq), YL = (Hq, Hq, ---.8n)s BF = (24) Sqy «+2 2q)> (28) 
Aim 
we get = PX, Y,Z}= (an myn eXPL— 2 4 (yl yy + Wyglig + ... + Ggglg5)]- (29) 
In the following our aim is to find the distribution of the quantities 1,,, li», ..., ss. 
k in (29) denotes the density at the point 
M = (24, Hy, «+5 ny Yas Yas +++ Ys 219 ap +++ Zn) (30) 


in a 3n-dimensional space; the origin is denoted O. Within this space we consider three 
n-dimensional subspaces, corresponding to the first n, the intermediate n, and the last n 
co-ordinates. The projections of M on these three subspaces are the points X, Y, and Zin (28) 


—_— ~~. 
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in the sense that for each point only the n co-ordinates belonging to the corresponding 
subspace are indicated (the other 2n being zero). 

For the time being it will be convenient to imagine that Y and Z, with the co-ordinates 
shown in (28), are placed in the same n-dimensional subspace as X. Thereby we are, inter alia, 
enabled to give a simple geometrical interpretation of all the I’s. Thus J,, means the square 
of the distance OX, while 1,, means the product OX .OY.cos¢,,, where ¢,. denotes the 
angle XOY, etc. 

In the n-dimensional space just mentioned we introduce a new co-ordinate system with 
the same origin O and in close relation to the points X, Y, and Z (Fig. 2): the 2,-axis is 
chosen along OX, the z,-axis perpendicular to OX in the plane OXY, and the z,-axis 
perpendicular to the plane OXY in the three-dimensional space OX YZ. The remaining 
n—3 axes may be chosen arbitrarily (subject only to the conditions of orthogonality). 




















2(b455095) 
#) 451,00) “4 
7 1 
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Fig. 2. 


The new co-ordinates of the points X, Y and Z are denoted as in Fig. 2 (where only the 
first three are shown, the remaining being zero). Further we may assume that the change of 
co-ordinates is carried out in such a manner that £, > 0, 7,>0 and {,>0. 

The /’s being invariant by change of co-ordinates and hence expressed in the same manner 
by the new and the old co-ordinates, we have 


li = he =f, hs = 4; 
loo = Mi +93, Les = 15+ Hebe, (31) 
lag = C+ C3 +S. 

In relation to any set of points X, Y, Z in the n-dimensional space we may introduce a 
new co-ordinate system in the above manner and determine the six characteristic quantities 
E55 M1» Ne» Sr» Se» Sg. To begin with the distribution of these six quantities is sought. 

With that in view we consider such sets of points X, Y, Z, for which the six quantities 
have fixed values and where, moreover, the points X and Y are fixed. The projection 
Z, = (&%, 9) of Z on the plane OXY will also be fixed, and the distance of Z from the 
plane has the constant value ¢,. The point Z, therefore, will be able to move on the surface 
of an (n — 2)-dimensional sphere of centre Z, and radius ¢,, situated in an (nm — 2)-dimensional 
space perpendicular to the plane OX Y in Z,. To Z we attach (see Fig. 2) a small element of 


42 
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volume df, d¢,d¢,. When Z moves on its spherical surface this element of volume will describe 
an n-dimensional volume S,, (fs) 46, d6,af5. (32) 


Next we consider such sets of points X, Y, where £,, 7, and 7, have fixed values, and where 
moreover X is fixed. The point Y will then be able to move on an (n — 1)-dimensional sphere 


of radius 7, and centre in the projection of Y on OX; a small element of area dy, dy, attached 
to Y will thereby describe a volume 


S,-1(12) 4, dN. (33) 
Finally, when X moves in such a manner that the value of £, is fixed, then a line-element 
dg, attached to X will describe an element of volume 


(1) 48). (34) 

We now return.to the point M in (30), the projections of which on three mutually ortho- 
gonal, n-dimensional subspaces are X, Y and Z in their original positions. To a given set of 
values £1, 73, Na, 1, Sg, 3 With corresponding differentials d£,, dy,, dy_, d¢,, df,, df, we obtain 
in the 3n-dimensional space an element of volume equal to the product of the three elements 


(32), (33) and (34), i.e. ‘ 
S,,(E1) S,-1(92) S,_2(Sg) dE, dy, dygdl, dl, dq. (35) 
Hence we have 


AP{Es, M1 Nas Sas Ses Ss} = KS (Er) Sp_a(M2) Spal $s) dE, 29 dal, do dls, (36) 
where « is given by (29). Thus we have found the required distribution of £,, 7,, 92, &, Se, fs, 
as by means of the formulae (31) these six quantitiés may be inserted in x. 

Substituting the values of the spherical surfaces in (36) we get 
n¢gn—1 n—1)yn—2 n—2)yn—3 
APXE,, 1, --+5 $3} = aes i Te df, dy, ... dg, 
—" n—-1yn-2¢n—-3 
+ Os} = “TGn) Pi(n—1)Pi(n—2) 1 ye "Sg *dE, dy, ... df. (37) 





thus dF {E,, 11, -- 





We shall now find the distribution of the l’s introduced in (27). The jacobian of the /’s in 
relation to £,,7,, ...,¢, may be split up into a product of three and becomes 














dl, A(lsa, tan) O(Ly9, lea, Los) E o | & Bini i 
11 *'\"12> “22 13> “23> “33 1 
med * ee m 1 0 | = 8é92t. 
dE, (1,92) O(L1, Se, Ss) St 29, 2nq || ecianeiiee Wits 
| 26, 20, 2; 
Hence we get 
m¥(3n-3) 
AP{1,1, 1,9, ---, 133} = K os —>H (E19 2Es)"* Aly, dls -.. dls. (38) 
P(gn) P}(n — 1) P4(n— 2) 
Moreover, by means of the rule of multiplying determinants we have 
hi he hs & 0 OF 
ley Ion los |=| 1 2 % | = (Ex %265)*, 
Igy Usp Ugg G o & 





whence (38) becomes 


dPihy, hs, 


(3n—3) Ly bs his jHn—4) 
W rs 


oooy gg} “Tq Tim—l) Tin) lL, bee by dl,,dl,....dlsg. (39) 
31 Iso I3 
This is the required distribution of the l’s, as x is expressed by the I’s in (29). 





37) 


in 


38) 


39) 
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We shall now repeat the proof in a manner which will act involve any geometrical aids. 


To do this, we proceed once more from (26) and introduce the I’s by (27). Furthermore, we 
introduce X, Y and Z by (28); then 


dP{X, Y,Z} = xdXdYdZ, (40) 


where x is determined by (29). We may for the sake of convenience continue to use the words 
‘point’ and ‘co-ordinate’. 
We consider an orthogonal transformation 


1 n 
hap Giht tthe) Ga | (S44): 
1 


t= yt +...+2jnt, t= 2,3,...,n, 
carrying (t,t, ...,t,,) into (t;, 4, ...,d,). Applied to the point, X it gives 
X’ = (€,, 0,0, ..., 0), 


all the co-ordinates of A’ except the first being equal to zero owing to the conditions of 
orthogonality 


(I) 


tann 


By (I) the points Y and Z are transformed into 


Y’= (1, Y2, ae Yn): Z'= (G, 23, away Zn), 
where the co-ordinates need not be calculated. The special symbols 9, and ¢, are due to the 


fact that these co-ordinates will not change by the two following transformations. 
Next we use a new orthogonal transformation 


gy y+ AjgFot ...+0;,%, =O (¢ = 2,3,...,2). 


i = ti 

” 1 taf ? 4f ve ’ 

= 7, 222+ +Yntr) Me = | (82): (II) 
2 

t = Bigta t+... +Binth t= 3,4,...,m. 


This transformation does not change X’, but carries Y’ and Z’ into 


Y” = (91,9, 9, -..,0), ZB" = (Cys Say Zs «+3 2%) 


%, and ¢, remain unchanged as noted above. The last n— 1 co-ordinates of Z” need not be 


calculated. The special symbol ¢, is due to the fact that this quantity is unchanged by the 
following transformation. 


Finally, we use a third orthogonal transformation 


Y= &, | 


m 1 "4H “wn / "2 | a) 
ts = ¢ (alg +.-.+2ntn) 6 1G) 
73 


t? = Yigts t+ ---+Vinltn 6 = 4,5,...,%. 
This transformation changes neither X’ nor Y”, but carries Z” into 
Zz" = (f. fs, ts, 0, coe 0). 


Thus we have once more introduced the quantities £,, 9,, 72, &, ¢, ¢,, known from the 


geometrical treatment, and as the /’s are invariant by orthogonal transformations we again 
have the equations (31). 








54 The gecmetrical method in the theory of sampling 


We now return to (40) and apply some transformations of variables: 
(1) For Y and Z we introduce Y’ and Z’, respectively, whereas X is left unchanged. As 
the coefficients of (I) depend only on X, the jacobians are equal to +1, and (40) is trans- 


arene dP{X,,, ¥i,6, Zi} = «dX dy, d¥idl,dZi, (41) 
where Y; = (yg, ...,y,,) and Z, = (z5, ..., 2). 

(2) For Z, we introduce the last n—1 co-ordinates from Z", while X, 7,, and Yj; as well 
as ¢, are unchanged. As the coefficients of (II) depend only on Yj the jacobian as above is 
equal to +1, and (41) becomes 

aAP{X, Hy, V4, Se, Za} = edX dy, d Yi dl, de,dZ,, (42) 
where Zs = (2, ..-, 2): 


According to (31) x may be expressed by the variables £,, 9, 72, &, &, ¢, only. Hence, as in 


n 
example 1, instead of X we may introduce £, = / (3 “t) together with U = (uy, Ug, ...,;Un_s); 


for Y; similarly 9, = / (3 uv?) together with V = (v,,¥9,...,U,—-2) and finally for Zs, 
i= J (3: “t) and W = So ..+,W,_3) as new variables. Eliminating U, V and W by 
cuneeiiien we get from (42) 

AP {Ess Nay Na» Sr» Sa» Sg} = KSy(E1) Spa(a) Sn—a(C5) 4514 Aad, dE, AEs. 
Thus we have once more proved (36) and may as before obtain (37) as well as (39). 


n n 
Just as we have seen in example 2 that ¥ (x;—%)* is distributed as }2?, but with n—1 
I 1 


instead of n, it may be shown that the variables 
n a n n 
i= & (%— 2), he= % (%—2) (Yi-Y), +05 Ugg = & (2-2)? 
are distributed as the /’s in (27), but with n—1 instead of n, %, ¥ and Z being the means of 
%;, y; and z; respectively. The proof is omitted here. 

Finally, it should be noted that the constants of the distributions dealt with in the above 
all enter automatically and need not be determined by a special process. The common 
source of all these constants is formula (4), giving the volume of the n-dimensional sphere. 
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PROOFS OF THE DISTRIBUTION LAW OF THE SECOND 
ORDER MOMENT STATISTICS 


By JOHN WISHART, School of Agriculture, Cambridge 


The foregoing paper by Prof. Fog (1948) calls to mind the different occasions on which proofs 
have been derived, by various methods, of the result first given twenty years ago by the 
present author (Wishart, 1928). It may be useful at this stage to catalogue these proofs, so 
far as known to the writer, and to comment on the contrasting methods employed. 

The method first used was a direct extension of the geometrical method of approach used 
by R. A. Fisher (1915), and was worked out in full for three variates, then extended to the 
general case by the use of quadratic co-ordinates. At the end of 1933 Prof. Mahalanobis sent 
the author a somewhat fuller proof on the same lines, which was published some years later 
(Mahalanobis, Bose & Roy, 1937) as part of a long study of the normalization of statistical 
variates and the use of rectangular co-ordinates in the theory of sampling distributions. 
A proof on entirely different lines had been published before the communication referred to 
from Prof. Malahanobis was received (Wishart & Bartlett, 1933). This depended upon working 
out the characteristic function of the distribution and then using a generalization of the 
Fourier integral theorem to express the result as a multiple integral, detailed consideration 
to which was given by Ingham (1933). Special cases of this method, and of the resulting 
integrals, had previously been considered for two variables by Romanovsky (1925). 

Part of the difficulty, as in all similar problems in the theory of sampling distributions, 
resides in the fact that the practical problem requires the moment statistics to be calculated 
from the sample means. This general feature, which is allowed for by writing n—1 for n, 
where n is the size of the sample, may be separated from the fundamental distribution 
problem, which is that of the simultaneous variation of the $4(k+ 1) sums of squares and 
products of k variate values x,(i=1, 2, ... k), which may be taken to follow a multivariate 
normal distribution with zero means. This was recognized by P. L. Hsu (1939), who obtained 
a proof by the method of mathematical induction which has the merit of being short. 
Madow (1938) deduced the distribution by generalizing from Hotelling’s joint distribution 
of sample correlation coefficients. Of the text-book proofs those of Wilks (1943) and 
Kendall (1946) are geometrical, and that of Cramér (1946) determines the characteristic 
function. Cramér also refers to a paper by Simonsen (1944, 1945). 

The distribution is a direct generalization of the x? distribution to the case of vectors with 
a number k (>1) of components. Reference should also be made to Bartlett (1933) who 
deduced the corresponding partial distribution when a number of variates, about whose 
distribution nothing need be assumed, are eliminated, and to Anderson & Girshick (1944; 
Anderson, 1946) who deduced cases of the corresponding non-central distribution analogous 
to the similar problem in the case of x”. Recently Elfving (1947) has used matrix methods 
to deduce Bartlett’s decomposition theorem (Bartlett, 1933) and states that the general 
distribution can be proved in this way, although a formal proof is not given. 

Prof. Fog’s proof, which provides an intéresting parallelism between the geometrical and 
analytical approaches to the problem, is only given for the case of three variates, but in 
contradistinction to former proofs his steps would seem to be such as to justify his statement 
that the generalization to an arbitrary value of k should cause no difficulties. It may not 
be out of place here to remark that the methods used by him in Examples 1 and 2 may be 
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used to give a geometrical interpretation to certain special orthogonal transformations 
which have been used in deriving tests of significance. It is true that the variables U need 


not be particularly specified, but it helps the elementary student if, for example, > (x—%)? 
and, in the regression problem, > (y—a—b(x —))* can be directly expressed in a envi 


way as the sums of squares of eat and n—2 independent normal variates respectively. 
A recent expository paper (Wishart, 1947) deduced all the results required for the proof of 
the variance ratio distribution by using the orthogonal transformation 


u=- (5) i41—-%,) (@ = 1,2,...,n—1), 


u, = .n.Z,, 


i n n—-1 
where 2}, Xq, ...,%, are normal (0,1) and %; = > (x,)/t. Then ¥ (x;—Z,,)? = ¥ (u}). Similarly, 
r=1 1 


for a regression relationship of the form Y = bx we can make the transformation (Vajda 


1945): z, 
%= “alle (Yes —9;% 441) (¢ = 1,2,...,n—1), 
i+1 
v, = Jz,.6 


where ¥,, Yo, ---»Y, are ‘neeunel (0, 1), the x; can be wera: as fixed, and 


= 3 (x,y,)/Xi» 2 = Mis x (x?). 


Then Sy,—-6 b,%;)* = "y (v9). 
I 


Jn both cases (the first is a particular case of the ala in which 2; is put equal to unity 
for all 7), the figure which applies is Fig. 1 of Prof. Fog’s paper. OQ? = q? represents &(x— 7)? 
in the one case and X(y—bzx)? in the other, since the linear relations are L(2x/,/n) = ./n.Z 
and X(yz/,/Z,,) = /Z,,.6 respectively, and this quantity is therefore the sum of the squares 
of (n—1) perpendicular distances from Q on to (n—1) hyperplanes through the origin 
orthogonal to a, and mutually orthogonal among themselves. Any one of an infinity of 
planes can be chosen for the first, and this corresponds to the statement that the variables 
U need not be specified. In our first illustration the plane is chosen as x, = 23, followed by 
2,+X, = 2x5, etc., whereas in the second illustration we start with x,y, = x,y, (where y, 
and y, are the variables, and the x’s are constants) and follow up with 

H5(X,Y, + LeYo) = Yg(xj + 29), ete. 
Finally, the distributions required are easily deduced from the fact that the joint probability, 
after transformation, breaks up into the product of independent parts. 

The more general regression relationship Y = a+6(x—Z) is dealt with by applying the 
first transformation to both the x’s and y’s, reducing the sums of n squares and products 
to the sums of (n — 1) squares and products of new variables u and wu’. To w’ is now applied 
the second transformation (using w) to a variable v’, in which i goes from 1 to n— 2, and 


, 
Va = VZn-1 ‘ By-1 


n—1 = 
where Ln-1= oy (u?), b,1= = (u,0)/Sn—1- 
n n—2 
We then have X(y— Y)? = ¥ (v7?) 
1 1 


(Wishart, 1948). This represents a particular application of Fisher’s general theorem (1925). 
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Geometrically, the position is as represented in the diagram, which is a further development 


of Prof. Fog’s Fig. 1. The first relation 
S (y/n) = ,/n.¥ projects the point Y on to 
I 


plane I through the origin in the point if 
QYi—9,---sYn—Y), and OY?=zi+qi, 
where z, = ,/n.7 and q,= /[Z(y—y)"]; the 


n—1 
second relation 5 (wu’//Z,_1) = JXp_-5 
i 





projects Q on to a plane II through the 
origin (orthogonal to plane I) in the point 
Q' (yi —Yy, ---s Yn —Yn): and Qi = 2+ 93, 
where z, = /,_,.6, and g, = /[Z(y— Y)*]. 
Q’ is confined to the (n—2) space deter- 
mined by the intersection of planes I and II. 
Altogether OY? = 2?+22+q3, and q2 can 
then be determined as thesum of the squares 
of (n — 2) perpendicular distances from Q’ on 
to (n—2) other hyperplanes through the 
origin orthog~nal to plane IT, and mutually 
orthogonal among themselves. Again an 


ei, Se 
—- 














infinity of planes can be chosen for the first, 
and the one we take is u.w; = u,u3, which 
can if desired be expressed in terms of the . 
original variables x and y as (x%,—23)y, Fig. 1. 





+ (%3—2y) Y¥+(%;—%_) ys = 0. The mutual independence of the distributions of 9,/n, 


b./[X(«—Z)*] and X(y— Y)?*, and their separate distribution functions, then follow. 
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1. INTRODUCTION 


Attempts have been made in recent years to generalize the univariate analysis of variance 
technique to the case of multiple variates. The extension of the theory has been slow and 
only a few methods have been made available for practical use. The starting-point of these 
researches is the simultaneous sampling distribution of the variances and covariances in 
samples from a multivariate normal population given by Wishart in 1928. A few years later 
Hotelling (1931) found the distribution of a quantity 7’ which is a natural extension of 
Student’s distribution to a sample from a multivariate normal population. 

Wilks (1932) following the likelihood ratio method (Neyman & Pearson, 1928, 1931; Pearson 
& Neyman, 1930) obtained suitable generalizations in the analysis of variance applicable 
to several variables. The statistic A proposed by him has been found useful in a variety of 
problems. Bartlett (1934) applied it for testing the significance of treatments with respect 
to two variables in a varietal trial and indicated its general use in multivariate tests of 
significance. Wilks (1935) and Hotelling (1935) found it useful in testing the independence 
of several groups of variates. Recently Plackett (1947) provided an exact test for judging 
the equality of variances and covariances of various populations, with the use. of this 
criterion. Wilks’ statistic supplied some of the basic tests in multivariate analysis but the 
problem of tabulation has not been tackled except in some limited cases (Wald & Brookner, 
1941). A very useful approximation has been suggested by Bartlett (1938) who further 
demonstrated its use in a paper on ‘Multivariate Analysis’ read before the Royal Statistical 
Society in May 1947. 

A new line of research was initiated by Fisher (1936) with his introduction of the dis- 
criminant function analysis. It has been shown (Barnard, 1935; Martin, 1935; Fairfield 
Smith, 1936) that a set of multiple measurements may be used to provide a discriminant 
function linear in the observations having the property that, better than any other linear 
function, it will discriminate between any two chosen classes such as taxonomic species, the 
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two sexes and so on. It has also been shown (Welch, 1939; Rao, 1947) that the linear 
discriminant function chosen as stated above is the best among all classes of functions not 
necessarily linear in the set of observations. 

The introduction of the discriminant function led to a new method of deriving test criteria 
suitable for multiple variates. The problem is reduced to the case of a single variate by using 
a linear compound of the several variables, where the compounding coefficients are chosen 
so as to maximize the value of a statistic suitable for a single variate. The application of 
this method to test the differences in mean values for several groups gave rise to the theory 
of canonical roots of determinantal equations (Roy, 1939; Fisher, 1939; Hsu, 19395). The 
distribution of the individual roots and the exact nature of tests require further study. 
Wilks’ statistic, which is a symmetric function of the canonical roots, may be con- 
sidered as providing an overall test of the hypothesis concerned. 

The object of the present paper is twofold. The first is to develop a unified approach to the 
problem of tests of significance in multivariate analysis. The concept of analysis of dispersion 
explained in §4(a), which is a natural extension of the univariate analysis of variance, has 
been found useful in discussing multivariate problems. In a recent abstract, Hotelling (1947) 
developed a method of splitting a generalized measure of dispersion which appears to be 
different from the method proposed here. 

The second is to examine the nature of Bartlett’s (1938) approximation and supply 
appropriate methods for cases needing the exact evaluation of the probabilities. 

In presenting the various tests of significance developed in this paper it has been found 
convenient to consider the problems arising out of a single sample and two samples in the 
first stage. They depend on simple tests of significance requiring the use of variance ratio 
tables alone and are of very great importance in practice. The use of Wilks’ statistic in multi- 
variate analysis involving more than two samples is considered in the second stage. A number 
of examples have been worked out to explain the computational procedure. 


2. TESTS WITH DISCRIMINANT FUNCTIONS 
(a) Two fundamental distributions 


The method of discriminant functions to derive test criteria has been found extremely useful 
in multivariate analysis. The problem is reduced to the case of a single variable by choosing 
a linear compound of the variables and constructing a statistic suitable for the case of a 
single variate. The maximized value of this statistic obtained by a suitable choice of the 
compounding coefficients is taken as the appropriate test criterion. The distribution of the 
statistics thus derived in problems involving a single sample and two samples depend on 
the two fundamental distributions considered below. 

Let (w,;), 1, j = 1,2,...,p be the matrix giving the estimates, on n degrees of freedom, of 
the elements in the dispersion matrix («,;) of p normally correlated variables. The definition 
of w,; implies that it has been calculated from a certain sum of products by dividing by the 
appropriate degrees of freedom. Let d,,d3,...,d, be p normal variates with the same dis- 
persion matrix (,;) but distributed independently of the w,;’s. Considering only the first 
r variables d,, ...,d, the statistic V, is defined as 


nw, => Dydd; (2-1) 
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where (w}/) is the matrix reciprocal to (w,;), i,j = 1,2,...,r. An alternative method of 
calculating this statistic is provided by the equation 


1+nV, = [wig + ded; | (s, j = 1,2,...,9). 
| wi; 
It has been shown by Hotelling (1931) that, when the w,; follow Wishart’s distribution (Wis- 
hart, 1928) with n degrees of freedom and EH(d,) = H(d,) = ... = E(d,) = 0, the statistic 


V,(n+1—r)/r can be used as a variance ratio with r and (n+ 1—r) degrees of freedom. 
The author has shown elsewhere (Rao, 19465) that, if d,,,,..., d,, are distributed indepen- 


dently of d,,...,d, and E(d,,,) =... = E(d,) = 0, E(d,) being not necessarily zero when 
i = 1,2,...,r, the statistic 
y = thee | (2-2) 
p-r \l+v, 


can be used as a variance ratio with (p—r) and (n+ 1—>p) degrees of freedom. The statistic 
V,, is calculated from the formula (2-1) by using all the p variates. 

All the tests of significance considered in this section depend on the use of the statistics 

defined in (2-1) and (2-2). ; 
(6) Problems of a single sample 

Student’s test connected with pairs of observations admits generalization in two directions. 

The first is to test whether the means of p correlated variables are the same on the basis 
of a sample of size N from a p-variate population. When the test shows differences in mean 
values, there arises the question of deciding whether an assigned contrast involving the 
p variates differs from the best contrast as determined from the data. _ 

If 114, Xj, ---, Zp»; are the observations on the ith individual, then they may be replaced 
by a linear compound z; = 1, 2,;+ ... +12); where the’s satisfy the condition 1, + ...+1, = 0. 
The problem of determining the best contrast reduces to that of determining the com- 
pounding coefficients 1,,...,1, such that the ratio of mean z to standard deviation of z is 
@ maximum. An alternative method which has some practical advantage is as follows. 

By arbitrary choice of constants one can construct (p—1) linear combinations of the 


variables 2; coos Lp» Y; == M45 % + RA + MyjX yp; 


such that > m,; = 0 for j = 1,2,...,(p—1). Choosing a linear compound of the z’s with 
coefficients editing to zero is the same as choosing a linear compound of the y’s without any 
restriction on the compounding coefficients. If the linear compound is 
Ayr tAgYet +--+ Ap-1Yp—-» 
then the quantity to be maximized is 
= Arti +--+ psp) 


nie, 
l N =i y? 
where y= VOI X (Yer— He) (Yjr— 95). 


Observing that only the ratios of A’s are uniquely determinable the equations giving A’s 
may be written a8 Aywyit+...+Ap apn =H% (6 =1,2,...,(p—1)), 
with the solution as ), — wlig,+...4 wig, (i= 1,2,...,(p—1)), 


where the matrix (w*/) is reciprocal to (w,;). This supplies the best linear compound of the 
y’s which on transformation to the z’s gives the best contrast determinable from the data. 





tic 


ics 


X’s 


| 


C. RADHAKRISHNA Rao 61 


The maximum value of v is given by 
LA, ¥; = Low 7, 9;. 
IfV,_, = N(2=w ¥,¥;)/(N — 1), then, on the hypothesis that all the z’s have the same mean 
value, the conditions required for the use of the statistic (2-1) are satisfied so that 


V,-(N —p+1)/(p—1) 
can be used as the variance ratio with (p— 1) and (N — p+ 1) degrees of freedom to test the 
above hypothesis. 

The statistic V,,_, is invariant for all sets of coefficients chosen to construct the y’s from 
the z’s so that in any practical problem either conveniently or conventionally chosen linear 
contrasts of the x’s may be used to define the y’s. 

The test used above is essentially the one given by Hotelling (1931). The point of interest 
is to show how the test is derivable by the method of discriminant functions involving some 
restrictions on the compounding coefficients. Also the author is not aware whether the use 
of Hotelling’s T in testing the equality of means of p correlated variables has been explicitly 
mentioned anywhere. 

To test whether the best contrast as determined from the data is in agreement with an 
assigned contrast £, 7, + ...+&, 2» OF 9, Y; + --- +%p-1Yy-1 in terms of the y’s one may proceed 
as follows. 

The appropriate statistic for testing the significance of the assigned contrast is 

V,= N( 91+ --- + Mp1 Vp)” 
(N-1)(2 29:9; w;;) 
where V,(N — 1) is the variance ratio with 1 and (N — 1) degrees of freedom. The appropriate 
statistic for all the (p—1) contrasts is V,_, as considered before. The hypothesis specifies 
that all contrasts orthogonal to the assigned one have zero mean so that the conditions for 
the use of the statistic (2-2) are satisfied. Hence 


_ (N-p+}) 1+Vy1 
0 = OS ti} 
can be used as the variance ratio with (p—2) and (N — p+ 1) degrees of freedom to test the 
above hypothesis. 

The above test can be generalized to answer the problem whether a set of k assigned 

contrasts contain the best contrast. In this case the statistic 
U = (N-—p+1) fs +4 i 
(p—k—-1) | 14% 
can be used as the variance ratio with (p—k—1) and (WN —p +1) degrees of freedom. 

The second generalization of Student’s ¢ is concerned with testing, on the basis of a sample 
of size N from a 2p-variate population containing the variables y,...,¥2, whether 
E(y,) = E(y;,,) for ¢ = 1, 2,...,p. 

From the 2p variates y,, ..., ye, one can construct the p variates z; = y¥;—Yj4p,4 = 1,2,...,p 
in which case the problem reduces to that of testing the hypothesis E(z;) = 0, = 1,2,..., p. 
The variance ratio with p and (N — p) degrees of freedom to test the above hypothesis is 

re TEwiz,z,, 
where (w*/) is reciprocal to (w,;) giving the estimates of the variances and covariances of 
the z’s. 
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This test may be useful in biometry where the asymmetry of organisms is considered. 
The sets of variables y,,...,y, and Yy,1,---,Y2,) Will then correspond to measurements on 
the right and left sides of an organism. 

Example 1. The data of Table 1 consist of weights of cork borings taken by the author 
from the north (N), east (E), south (S) and west (W) directions of the trunk for 28 trees in 
a block of plantations. The problem is to test whether the bark deposit varies in thickness 
and hence in weight in the four directions. It was suggested by Prof. Mahalanobis that the 
bark deposit is likely to be uniform in N and § directions and also uniform but less in E and 
W directions, so that N—E—W+S can be taken as the best contrast. This can, however, 
be tested from the given data as shown below. 


Table 1. Weights of cork borings (in centigrams) in the four directions for 28 irees 
































N E s Ww N E s Ww 
| 72 66 76 17 91 79 100 15 
60 53 66 | 63 56 68 47 50 
56 57 64 58 79 65 70 61 
41 29 36 38 81 80 68 58 
32 32 35 36 78 55 67 60 
30 35 34 26 46 38 37 38 
39 | 39 31 27 39 35 34 37 
42 | 43 31 25 32 30 30 32 
37 40 31 25 60 50 67 54 
33 29 27 36 35 37 48 39 
32 | 30 34 | 28 39 36 39 31 
63 | 45 74 | 63 50 34 37 40 
54 46 60 | 52 43 37 39 50 
47 51 52 | 43 48 54 57 43 











It has been found in similar studies that there exists a significant correlation between 
contrasts such as (N — E) and (S— W) so that the method of fitting constants for the four 
directions and the individual trees by the method of least squares is not appropriate. 
The three contrasts arising out of the four weights may, however, be treated as three 
correlated variables in which case the theory developed above js applicable. 

It is interesting to observe that the individual weights in Table 1 are exceedingly asym- 
metrically distributed.* This does not, however, invalidate the test so long as the contrasts 
are normally distributed. In fact, the distribution of the individual weights depends on the 
nature of the plants and the variation between plants. If the above condition is satisfied, it is 
not necessary that the individual weights should follow any distribution law of the known 
type. It may be sometimes necessary to make a transformation (such as log, square or 
cube root) of the variables under consideration to ensure that the contrasts of the trans- 
formed variables are symmetrically distributed if the contrasts of the original variables 
are not so. 

As observed earlier the contrasts may be conveniently or conventionally chosen. For the 
above example one may choose the simple set of contrasts 


vy =N-E-W+8, y,=S-W, y=N-S. 


* I am indebted to Prof. E. S. Pearson for drawing my attention to this fact. 
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The mean values and estimates of variances and covariances based on 27 degrees of 
freedom for the y’s are J, = 88571, ¥, = 45000, 9%, = 0-8571, 
(w,;) = / 128-7200 61-4076 — 21-0211 
( 61-4076 56-9259 — 28-2963 
— 21-0211 —28-2963 63-5344 


‘The coefficients in the best linear function A,y, + Ayy, + Agys are given by the equations 


128-7200A, + 61-4076A,— 21-0211A, = 8-857], 
61-4076A, + 56-9259A, — 28-2963A, = 4-5000,- 
— 21-021 1A, — 28-2963A, + 63-5344A, = Q-8571. 
Solving, one gets A, = 0-05620, A, = 0-04415, A, = 0-05174, 
so that the best contrast is 
A,(N -E—W +8)+A,(S— W) +A,(N —S) 
= 0-10794N — 0-05620E — 0-10035W + 0-04861S, 
or 1-0794N — 0-5620E — 1-0035W + 0-4861S, 
obtained by multiplying the coefficients by 10 (arbitrarily). 
The statistic for testing the hypothesis of equality of means is 
ha= 7 (Ay¥i + As¥o+As¥s) 
= 28(0-740790) = 0-768226. 
V,_,(N —p+ 1)/(p—1) = 0-768226(28— 4+ 1)/3 = 6-4019. 
The quantity 6-4019 as the variance ratio with 3 and 25 degrees of freedom is significant 
at 1% level so that the bark deposit cannot be considered uniform in the four directions. 
The assigned contrast is represented by y, and to test for its significance one can construct 
the statistic vie NR : 28 (8-8571) aren 
1 N—1w,, 27128-7200 sive: 
The quantity (N —1)V, = 17-0645 as the variance ratio with 1 and 27 degrees of freedom is 
highly significant. 
To test whether the assigned contrast agrees with that estimated from the data, the 
statistic U defined in (2-2) has to be calculated. 
is N-p+l (Aa | a > {passa 
p-2 1+V, 





a 1\ = 1-0431. 


1-632020 | 
This value of U as the variance ratio with 2 and 25 degrees of freedom is small so that the 
evidence supplied by the data is not sufficient to reject the assigned contrast as not the best, 
although the ratios of the coefficients in the estimated contrast depart considerably from 
those assigned. 


(c) Mahalanobis’ D* and problems of two samples 


Let N, and N, be the sample sizes from two populations 7, and 7, characterized by (p+¢q) 
variates. The sample means for the ith character are represented by %,, and %,, for 7, and 7, 
respectively. The estimated value of the covariance-is given by 


N, N: 
(N, +N —2) w= = (%ixe — Fi) (Vjpux— Fj) + 2 en — Fig) (Tjy— Zjq)- 
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Mahalanobis’ (1936) distance between the two populations as estin.ated from the sample 
on the basis of the first p characters is 
P Pp oe i) ia “ 
Di = = 2 wp Fen — 42) (Xj — Xa), 
i=1j= 
where (wif) is reciprocal to (w;;), i,j = 1,2, ...,p. The exact distribution of D? on the hypo- 
thesis specifying real differences in mean values has been given by Bose & Roy (1938). 
To test the hypothesis specifying no difference in mean values of the p characters for 7, 
and 7, the statistic N,N,(N, + N,—p—1) 
P(N, + N,)(N, + N,—2) ” 

can be used as the variance ratio with p and (N, + N,— 1 —p) degrees of freedom. The appro- 
priate distance function based on (p+ q) characters is 





Diag = VUwH, (Fix — Fa) (Zp — Ze)- 
To test whether the g additional characters lead to significant differences between 7, and 772, 
independently of the first p characters, a comparison may be made of the magnitudes of 
D3, and D?,,,. One may choose the ratio 

_ 14+.N,N, D5 4q/(Ni + Ne) (Mi + M2— 2) 

~ -14+N,N, D2 /(N, + N,) (N+ Ny—2) 
which has some theoretical advantage as observed in the next section. The conditions for 
the use of the statistic defined in (2-2) are satisfied so that 
_N,+N,—-p-q-1 
a q 
is the variance ratio with q and (N, + N,—p—q-—1) degrees of freedom. 

It has been shown by Fisher (1938) that the test with Mahalanobis’ D* is equivalent to 
testing the difference in the mean values of the discriminant function as estimated from the 
samples. Apart from tests of significance, the discriminant function is used for the purpose 
of assigning an individual to its proper class. This leads us to the problem of determining the 
number and nature of characters used in order that the errors of classification may not be 
large. It is, however, to be expected that the errors of classification will decrease as the 
number of characters is increased. On the other hand, since the various characters are 
correlated with one another the addition of some characters to a basic panel may not reduce 
or at any rate substantially decrease the errors. In this case, it may not be worth while to 
increase the number of characters so that the numerical computation involved may not be 
heavy. A test designed to judge the significance of the reduction in errors of classification 
by the addition of some new characters is valuable in problems of this nature. Such a test 
is mathematically equivalent to a test of differences in mean values of the new vari=bles 
after eliminating the differences in the basic characters. If p is the number of basic characters 
and q the number of additional characters the test may also be conceived as a comparison 
of Mahalanobis’ distances based on p and (p+q) characters. 

If it is desired to test whether an assigned discriminant function 7,7, + ... + 9,%, of 
p characters differs from that calculated from the data, then the statistic 

N, + N,—p—1{1+N,N,D5/(N,+N,)(N,+™,—-2)  ,) 

p-1 = \14+.N, N,D3/(N, +N.) (N,+N,-2) J 
where Dj === 9,9;(%;, —%i2) (%, —F; 2)/X XU yy;w;,;, can be used as the variance ratio with 
(p—1) and (N,+N,—p—1) degrees of freedom (Fisher, 1940; Bartlett, 1939). 
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Example 2. The following Tables 2 and 3 reproduced from Fisher (1938) give the mean 
values based on fifty observations each and the covariances based on 50+ 50—2 degrees 
of freedom for four characters in two species of plants Iris versicolur and Iris setosa. 

The solution of the equations 


AyWyzt-..+Agwy =d; (¢ = 1,2,3,4) 
is obtained as 


A, = —3-0528, A, =—18-0229, A, = 21-7662, A, = 30-8442, 
so that the discriminant function is 
— 3-0528x, — 18-0229z, + 21-7662z, + 30-8442z,. 

The value of D? is* A, d, +... tAgd, = 103-2335. 
To test for the differences in mean values one can use the statistic 

N,NAN, + N.—1—4) D3 50x 50x 95 

(N,+N,)(N,+N,-2) 4 100x98x4 

= 25(26-3350) = 625-4515, 

which as the variance ratio with 4 and 95 degrees of freedom is highly significant. 





x 103-2335 


Table 2. Observed mean values based on fifty observations each for the two species 











| Character Iris versicolor | Iris selosa Difference (d) 
; | 
Sepal length (z,) 5-936 5-006 0-930 
Sepal width (z,) 2-770 3-428 — 0-658 
Petal length (3) 4-260 1-462 2-798 
Petal width (z,) 1-326 | 0-246 1-080 











Table 3. The pooled covariance matrix based on 98 degrees of freedom 























| | a Xs Zs u% 

| : 

x | 0-195340 | 0-092200 0-099626 0-033055 

1 | 

Le 0-092200 0-121079 0-047175 0-025251 
Xs 0-099626 0-047175 0-125488 | 0-039586 
Xs 0-033055 | 0-025251 | 0-039586 0-025106 
| 








If only the lengths are considered (i.e. x, and z,) the equations leading to the discriminant 
function are 0-195340p, + 0-099626n, = 0-930, 
0-099626y., + 0-125488n, = 2-798, 
so that ~, = — 11-1088, vw, = 31-1163 and 
D3 = ,(0-930) + x9(2-798) = 76-7322. 
To answer the question whether the widths (x, and x,) supply independent information 


the significance of the ratio 


a 1+ N,N, D3/(N, + Ne) (N+ N2— 2) 


~ 14+N,N,D3/(N, + Ne) (N+ No—2) 

1 + 26-3350 
= —__—___- = ] +3286. 

1+ 19-5745 

* This method of calculating D* avoids the actual inversion of the matrix (w,;). The A coefficients 
obtained by this process can be directly used in the construction of the discriminant function. 





Biometrika 35 5 
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has to be tested. The value of the statistic 
U = (R—1)(N,+N,—1—4)/2 = 95(0-3286)/2 = 15-6085 
as the variance ratio with 2 and 95 degrees of freedom is significant at 1 % level. This shows 


that the widths in association with the lengths lead to further discrimination of the species, 
so that there is a significant reduction in the errors of classification. 


(d) Test for the equality of discriminant functions 

If four samples of sizes N,, N,, N, and N, from populations 7, 7, 7, and 7, are available 
one can test whether the discriminant functions between 7,, 7, and 73, 7, are “ignificantly 
different by an extension of the test criterion discussed above. It is a necessary condition of 
the test that the variances and covariances are identical in the four populations 7, 75, 73 
and 7,. No reasonably simple test can be constructed to establish the equivalence of the 
discriminant functions when this condition is not satisfied. 

Let (w;;) be the dispersion matrix based on (N,+N,+N,+N,—4) degrees of freedom. 
If d,,...,d, are the differences in mean values for 7, and 7, and dj, ...,d;, are those for 7 
and 7, the test for equality of discriminant functions is identical with the testing of the 
— E(d,) = Edi) (i = 1,2,....), 
or E(d,;) = E(-d;) (¢=1,2,...,p). 

The variance ratios with p and n = (N,+ N,+N,+N,—3-—p) degrees of freedom for the 


two cases are 
SN)  sswti(d,—di) (d,— a) 


pnt+p—1 
n_ f(N) ij ’ ' 
and p n+p-—1 Low i(d; + d:) (d; +d}) 
where am-(xtutety) 
f(N) N, N, Ns NJ 


The equality of discriminant functions is indicated if at least one of the statistics is not 
significant. Similar tests can be constructed for judging the differences in discriminant 
functions in parallel samples from two populations or between 7,, 7, and 7, 73. 


3. GENERALIZATION OF D® AND THE LARGE SAMPLE THEORY FOR SEVERAL GROUPS 
Let there be k multivariate populations 7,, 7, ..., 7;, from which samples of sizes N,, Ng, ..., N, 
are available for p +q characters. The common covariance matrix assumed to be known or 
estimated on a large number of degrees of freedom is represented by («¥)) for the first p 
characters and by (a+) for all the (p+q) characters. The inverse of («¥)) is represented 
by (aij) and that of (a+) by (a4, )). Let %,,, Z,2, ... be the mean values of the ith character 
in the first, second, etc., populations. 


It has been shown by Hsu (1939a) and Rao (1945) that the statistic, 
p T) Eye eee 
Vote = E> as) 2 Ni (€ir— Xs.) (Fin %},), 


where %; = (XN,z;,)/(Z=N,), can be used as x? with p(k—1) degrees of freedom to test the 
hypothesis that the mean values are the same in all the k populations for these p characters. 
The statistic V,,, is a suitable generalization of the Mahalanobis’ D? in its classical form and 
its theoretical derivation has been discussed by the author (Rao, 1945). 
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When this test indicates differences in mean values it is, in some problems, necessary to 
test whether the observations on q additional characters supply independent information for 
discrimination. The statistic for testing the differences in means for all the p + q characters is 


pia ti 
Vorak = 22 A+0 UN Gr %.) (%j,—%;.); 
43> f= 


which can be used as a x? with (p+q)(k—1) degrees of freedom. The 9(k—1) additional 
degrees of freedom bring in the contribution 


Vo+a.k —Vp,te 


and the significance of this difference can be appropriately used to judge the significance of 
the information supplied by the additional characters. This difference can be used as a x* 
with q(k— 1) degrees of freedom as shown below. 

The hypothesis that the new characters do not lead to further discrimination of the 
populations specifies that any linear function of the (p+q) characters uncorrelated with 
each of the p characters has the same mean value for all the k populations. There are g such 
linear functions and treating them as q variables a x* with q(k — 1) degrees of freedom can be 
constructed to test the above hypothesis. The above method of taking the difference is only 
an alternative way of calculating this x*. For V,,,,, calculated from all the (p + q) characters, 
being invariant under linear transformations of the variables, is equal to V, , + x* calculated 
from the p original characters and the g linear functions chosen to be uncorrelated with each 
of the p characters. 

In the above derivation it has been assumed that the variances and covariances are known 
and the distributions are asymptotically correct when they are estimated on a large number 
of degrees of freedom. When more than two populations are involved the pooled estimates 
of the covariances have, usually, a sufficiently large number of degrees of freedom to validate 
the use of the asymptotic distributions. More exact tests for cases involving small numbers 
of degrees of freedom are given in the next section. 


4. TrEsts witH WiLks’ A CRITERION 
(a) Analysis of dispersion and the theoretical aspects of the A criterion 


In the univariate analysis of variance tests of significance reduce to the comparison of two 
independently distributed mean squares. One of the mean squares is an unbiased estimate 
of the variance to which a single observation in any particular class is subject and is called 
the error variance. The other is only so when the null hypothesis which is being tested is 
correct and may be called the mean square due to deviation from the hypothesis. The test 
depends only on the individual degrees of freedom of two mean squares. 

When each observation consists of p mutually correlated variables there are p total sums 
of squares and p(p— 1)/2 total sums of products which can be analysed into various cate- 
gories. This process which involves the technique of analysing the variances and covariances 
of multiple correlated variables may be termed the analysis of dispersion.* The term 


* Prof. R. A. Fisher suggested that this method can be described as either analysis of covariance 
or analysis of dispersion. Since the term covariance analysis is conventionally used in problems of 
adjustment for concomitant variation, I have used the term analysis of dispersion to cover a wider 
variety of problems considered in this article. 


5-2 
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dispersion has been used by Prof. Mahalanobis to indicate the scatter of a set of observa- 
tions as measured by the variances and covariances. Following this terminology the total 
dispersion may be said to be analysed into dispersion due to various categories. 

If we represent the total sum of products by the matrix S = (S,,), then the analysis of 
dispersion consists in analysing each element such as S,,;, according to the usual procedure, 
into various categories with the corresponding distribution of degrees of freedom. The dis- 
persion due to any category supplies the sum of products (denoted for brevity by s.P.) 
matrix which on division by the degrees of freedom gives the mean product (denoted by 
M.P.) matrix. The s.P. matrix leading to unbiased estimates of the variances and covariances 
to which a single set of variables is subject is called the s.p. matrix due to error. This error 
matrix may be denoted by W with w as its degrees of freedom. In the analysis of dispersion 
the s.p. matrix due to any other category leads to unbiased estimates of variances and 
covariances only when the null hypothesis regarding that category is true. This may be 
called the s.p. matrix due to deviation from the hypothesis. If such a matrix is represented 
by Q with q as its degrees of freedom, then the problem of testing the null hypothesis consists 
in comparing the matrices w-! W and q-!Q. The simultaneous comparison of the estimates 
of the variances and covariances appears to be a natural extension of the comparison of 
variances in the case of a single variate. 

The appropriate test criteria for comparison may be obtained by extending the method 
of discriminant function analysis. A linear compound of the variables is taken and the com- 
pounding coefficients are chosen such that the ratio of mean squares due to deviation from 


hypothesis and due to error for this variable is a maximum. The ratio F? which comes out 
as a root of the determinantal equation 





_4 poy|—o 
o-1 Pw 0 


may be used as the appropriate test criterion. If | W|+0, the number of non-zero roots of 
this equation is equal to the number of variables under consideration or q, the number of 
degrees of freedom of Q, whichever is smaller. An adequate comparison of w—! {V and qQ 
must involve the tests of significance of all the roots. If F?, F3, ... represent the various roots, 


it is easy to verify that (1429) (142m). =e, 
w w |W | 

The ratio | W|/| W+Q| denoted by A decreases as the roots increase and a significantly 
small value of A may be taken as providing the significance of one or more of the roots. 
This is the underlying theory of the A criterion arrived at by Wilks (1932) by using the 
likelihood ratio method and later extended by Bartlett (1934)* for general use in multivariate 
analysis. 

This, however, does not provide a satisfactory test, for when only one or a smaller number 
of roots than the total indicate real differences, their significance may be obscured by the 


use of the overall test. Its use can be recommended only in situations where small deviations 
from the hypothesis can be ignored. 


* In a paper read before the Royal Statistical Society in May 1947 (Bartlett 1947), Dr Bartlett 
suggested a method of factorizing A, arising out of a category in the analysis of dispersion, which 
appeared different from the procedure I have outlined above. In my discussion of Bartlett’s paper, 
I pointed out the difference between his approach in some problems and the general approach by the 
method of analysis of dispersion, which alone I think can lead to unbiased tests of significance. Such 
a factorization leads to a valid test in the case g=1 as I have shown elsewhere (Rao, 19466, p. 409, 
equation 2-14). But this is not true in general. 
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(b) The distribution of A and its practical use 
The following notation will be used throughout this and the subsequent sections. 
Analysis of dispersion for p variables 











Due to D.F. S.P. matrix 
(1) Deviation from hypothesis q Q 
(2) Error n—q Ww 
| 
(3) Total n W+Q 

















A=|WI/|W+Q| 
If the number of variables involved is p, then assuming that the elements of W are 
distributed independently of those of Q it is easy to derive the tth moment of A (Wilks, 1932; 
Bartlett, 1934) as P-11{1(n—i)} T3(n—q—i) +h 
io P{d(n—q—1)} PE (n—-2) +8 
The tests based on the exact distributions given by Wilks (1932) and Nair (1939) for some 
particular cases are reproduced below. 


























Nature of test 
Variance ratic Degrees of freedom 
q = 1, for any p 1~An—p p and (n—p) 
A Pp 
1—,An-—p-1 
q = 2, for any 2 or . 2p and 2(n—p—1) 
1—An— 
p = 1, for any q » Sar q and (n—q) 
1—JAn-—q-1 
p = 2, for any g ee - 2q and 2(n—q—1) 











For other values of p and q, the exact values of the probabilities can be obtained by the 
use of the x? tables alone as shown below. 
It has been shown by Wald & Brookner (1941) that the distribution of the statistic 
v = —log A is of the form io Bw" 
2tPaC'(n) aaa | > 5 ) dv, 
s=0 2*+tPaT'(s + $99) 


—1] r oA > 
where C(n) ~The 
: (n/2)kPe 

C(n) 


sm = for Pry fey. 


n n® 





and the ’s are the coefficients in the expansion of in powers of 1/n, 














70 Tests of significance in multivariate analysis 


For the purposes of examining Bartlett’s approximation aud obtaining a quickly con- 
vergent series for the tabulation of percentage points, the transformation 


V= (n-P**"), = mv 


is made. Changing over to V from v the above distribution becomes 








oo ys 
ipa —ipde-W Viral > rs 
2472 D(m) m-*?¢ eV V (S esr ve 
pal {5(m+2*e** _)} 
2 2 
eee D(m) = TI j 
i=0 r 1 p-9! } 
s(*+—. —-* 


It is easy to recognize that the y’s depend only on p and q and that they are the coefficients 
(m/2)kPa 
D(m) 





in the expansion of in powers of 1/m. 


(m|2)é00 


The asymptotic expansion of Dom) 





can be calculated from the formulae 








| 
(m=) D(m) bets tang 
D 3) : 
a eee. Bue... 


per Dim) _ *7'm—-t+(p—qt+1)/2 
Dim+2) 429 M—i+ (pt+q4t])/2° 


Taking the logarithms of the first equality one gets 


oil Py s v1 
log (70+ 45 +-..) “ log (145) + log (7 + M+...) 


p-—qt+1—2i)\ _ pt+q+1-—2 
+ Blog(1+ = Slog (14272 == x 


Expanding in powers of (1/m) and equating coefficients of like powers on both sides, the 
first five y’s come out as 





ge 1% —_ , 
N= So tq Z (lp—q+1-2%i)-(p+q4+1—2i)} 

2° 16, 

0 


1 . ‘ 
Yo = + D {(ptq+1—-2i)-(p—q+1-2} 
3°06 
Pq 
3 


* That the value of y, = 1 is easily seen by making m->oo in the distribution of V in which case it 
is reduced to the x* form. The comparison of the coefficients, in fact, give the values of the ratios 


VilYo YelVo eeee 


he 


e it 
tios 
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Ya = 2ya+ Pls 22'S ((p— a4 1-21) (p+ q41-299 


= 27,47 — Hepa p+? +3) 


= 0, 
—'s 1 »-1 ns _ 
Ya = — 4Yat 9 — EPI + Fogg X (P+9+1— 2% —(p—g+1—25)} 
= — 47,48 tpg + =*T {apt + 3q*+ 110(p? + g*) + 10p*g? + 127} 


— Vi, PY san 292 50( p?-+92) 4 
~< + F990 8? + 3q*+ 10p*q? — 50( p? + q?) + 150}. 
Considering only terms up to the fourth power in (1/m) the distribution of V becomes 


2 \ ia 1 Y. vy? 4% > 
—W Vive ne] pa 
( ) D(m)e aerapat m? 22+4pay'(2 + pq)’ mi 244 T'(4+4p9))° 


The probability of V exceeding an observed value %, then, becomes 


2\tpa Y. Y. 
(=) Dim) {Poa + Ys Preset 24 Ppeset “f 





where 


Piq+s = Probability of x* with pg + s degrees of freedom exceeding the value . 


tpg 
One may go a step further and expand (=) D(m) in powers of (1/m) in which case the 
above series becomes 


Pog + 7% (Pogsa— Pig) + i (aP pats Poa) — VtPera— Pog)} + soe 

This form is most convenient for the calculation of the required probability. The quantities 

Y2 and y, are simple functions of p and q only. Using x? tables, the y’s and powers of (1/m), 

the probability of V exceeding V, can be calculated to a sufficient degree of accuracy. 
Bartlett (1938) suggested the use of 


V =—mlog,A = = (n- EE) log, A 


as x? with pq degrees of freedom. This corresponds to using the first term of the series. Since 
the second term is 0(1/m?), its contribution is very small even for moderately large m so 
that, in many practical problems, Bartlett’s approximation can be safely used. For small 


values of m one may use the second and the third terms depending on the accuracy needed 
in any problem. 


(c) Test of differences in mean values for several populations 
Let 7,,...,7, be & populations from which samples of sizes N,,...,.N, for p correlated 
variables are available. The dispersion has to be analysed into ‘between’ and ‘within’ 
populations. The s.p. matrix ‘within’ populations (the error) has N, + ...+N,—k degrees 
of freedom and that ‘between’ populations has (k—1) degrees of freedom. If these are 
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represented by W and Q then iu statistic to be used for testing the differences in mean 
values is 





= —mlog, A, 
where A=|W|/|W+Q|, 
dei n—Ptate 
n=N,+...+N,-1, 
=k-1 


The exact probability of V exceeding the observed value can be calculated as explained in 
§4(b). 

Example 3. Table 4 gives the analysis of dispersion for the three characters, head length 
(x), height (x,) and weight (7,) measured on 140 schoolboys, of almost the same age, belonging 
to six different schools in an Indian city. 


Table 4. Analysis of dispersion 





S.P. matrix 
Dispersion D.F. 





2 2 2 
as a vs XX XXy LX 





‘Between’ schools 5 (Q:3) 752-0 151-3 1612-7 214-2 521-3 401-2 
*Withi:’ schools 134 (Wi) 12809-3 1499-6 .| 21009-6 1003-7 2671-2 4123-6 





Total 139 (S;;) 13561-3 1650-9 22622-3 1217-9 3192-5 4524-8 
































12809-3 = 214-2 521-3 
214-2 1499-6 401-2 
|W | | 521-3 401-2 21009-6 








ies [S| | 13561-3 1217-9 3192-5 
1217-9 1650-9 4524-8 
3192-5 4524-8 22622-3 
_ 10#(0-176005) 
~ 1012(0-213628)’ 
—log, A = 0-193724, 
m = 139—}(54+341) = 1845, 
V =—mlog, A = (134-5) (0-193724) 
= 26-0559. 
Using V as x” with pq = 15 degrees of freedom the first approximation comes out as 
P,, = 0-0375. 
The second term is ts (Piy—FP,); 
29 x 15 Y. 29x15 
where "= and m? ~ 48(134-5)2 = 0-00050096, 


Ys (Pyy— P,;) = 0-00050096(0-1285 — 0-0375) 
= 0-00004574, 


an 


th 
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This correction to the first approximation affects only the fourth decimal place so that 
correction is hardly necessary. The observed value of V is significant at the 5 %/, level showing 
thereby that boys of various schools differ in physique. This appears to be generally true 
since boys belonging to different social strata attend different schools. 


(d) Internal analysis of a set of variates 


Let 2,...,%5, %y415-++)%s4p be (8+) correlated variables for which samples of sizes 
N,, ---, Nj, ave available from & populations. If the differences in mean values of these (s + p) 
variables are to be tested for significance, then the method given in §4(c) can be used. An 
important problem that arises in biometry is to test whether the variables, say 2,,,, ---,% ip 
bring out further differences in populations when the differences due to 2, ..., x, are removed. 

It is apparent in problems of this nature that some of the variables in the set 2,, ..., 2, 
might be in the nature of concomitant variates which have been observed in association with 
the dependent variables or which might have been chosen to have some specified values. 
An illustration of such an analysis is given in my discussion on Bartlett’s paper (Bartlett, 
1947). In that problem there were three dependent variables g, h and i corresponding to 
linear, parabolic and cubic terms of growth curves of pig weights and a concomitant variable 
w giving the initial weight of pigs. It was desired to test whether the variables h and ¢ bring 
out further differences in food treatments when the differences due to g and w are eliminated. 
The problem is identical with that posed above with g, w forming the first set and h, ¢ the 
second set of variables. 

There is a third set of problems in which it is desired to test whether the differences in 
k groups characterized by (s+) characters can be explained by variations in s assigned 
linear functions of these variables. If y,, ...,y,,, are the (s+) variables and 


[, = M139, +... + M1, nisYpis> 


POP e eee eee eee eee eee eee eee eeEeeeseeses 


L, = My Yt... + Ms, ptsY pis 


are the assigned linear functions, then one can replace the (s+) variables y,,...,y,,, by 


Ly, --+)%4p defined by 


y=, ... %=D, 


Voi = Mey Yat --- + Moir sinYsip» 


Xsip 7 Msin141 +... Moin, sip Ys+-p> 


where the coefficients in 2,,,,...,%,,, are chosen arbitrarily subject to the condition that 
the determinant | m,;|, 1,7 = 1,2,...,(s+p) is not zero. This latter condition ensures that 
the transformation from the y’s to the 2’s leads to one-to-one correspondence. Once again, 
the problem is reduced to that of considering the differences in ,,,, ...,%,;, When those due 
to x,,...,2%, are removed. The proposed test is independent of the compounding coefficients 
used to define the set x,,,,...,%,,, so that, in any practical problem, they may be con- 
veniently or conventionally chosen. 

In all these cases, the problem is one of analysing the dispersion of the variables 
541) +++)%;» When the dispersion due to 2,, ..., 2, is removed. This can be done by following 


the covariance technique suitable for p dependent variables and s independent variables 
(Wishart, 1936, 1939; Rao, 1946a). 
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Let (S;;) = (Qi;) + (Wi;) (t,9 * 1,2, -++)(8+p)) 
be the analysis of dispersion for all the (s+) variates due to deviation from hypothesis 
and error with the corresponding distribution of degrees of freedom as 


n' = q+(n'—q). 
The s.P. matrix due to error for the variables z,, ...,z, to be eliminated is 


see eeereecseese 


and its inverse is represented by (. ats « 


wai Wwss 
The s.P. matrix due to error for 2,,,, -++)% 4» When corrected for 2,,...,2,, is given by 
W(s+1,...,8+p|1,...,8) or simply W(p|s) where 
W(p|s) = (= oo 4 
Werpsrr => Warner 
(. “ie! a) ( =s9 « ) (= yea ec) 
Wystp => Wastp) \W ... We) \Weser --- Waetp 


This form which involves the evaluation of a triple product of matrices appears to be most 
convenient for computation as illustrated in the next section. Replacing W by S one has 
the formula for computing the s.p. matrix due to ‘deviation from hypothesis + error’ for 
Wo445 +++) y+» When corrected for x,,...,2,. If this is represented by S(p | s) then the required 
criterion is maa | W(p|s) | 
| S(p|s)| 

The degrees of freedom for W(p|s) are (n’—q—s) and for S(p|s) are (n’—s) so that in 
standard notation the parameters associated with A are 


n=n'-—8s, p=p, q=4. 
The test car be carried out as discussed in § 4 (5). 


(e) Barnard’s problem of secular variations in skull characters 


The problem of measuring secular variations in skull characters considered by Barnard 
(1935) is of immense importance to the anthropologists. It is, however, of interest to examine 
the methods employed by her in the light of latest developments in multivariate analysis. 
The two problems involved in her study are 

(i) the selection of a smaller number, out of seven skull characters, which give significant 
information, so far as is possible, as to changes taking place with time in four series of Egyp- 
tian skulls, and 

(ii) the determination of an expression, linear in measurements, which characterizes 
most effectively an individual skull with respect to the progressive secular changes. 

To answer problem (i) Barnard first chose Basi-alveolar Length and Nasal Height as two 
basic characters which independently of each other, show significant variation in the four 
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series. To choose further characters she considered the problem of testing the significance 
of the linear regression of the mean values of an added character with time (corre- 
sponding to the four series) when that part of the regression due to the two basic characters 
is removed. This meant the choice of characters with special reference to the average linear 
rate of change of the individual means with time. If the choice of characters is to be with 
reference to the complete nature of changes taking place with time, then what is needed is 
an internal analysis of the characters to decide whether the configuration of the four series as 
determined by several! characters is the same as that indicated by a smaller number. Bar- 


nard’s method should, of course, be preferred if the regressions were known to be linear. 
This can, however, be tested from the data. 


by 


, in 


Taking the four measurements 


the relevant data are suramarized in Tables 5 and 6 which give the means for the four series 


x, Basi-alveolar Length, 
x, Nasal Height, 


x, Maximum Breadth, 


x, Basi-bregmatic Height, 


and the analysis of dispersion. 


Table 5. Means for the four series 


















































Series 
Character 
I iil IV 
N,=91 N, = 162 N, = 70 N, = 75 
Z, 133-582418 134-265432 134-371429 135-306667 
Xe 98-307692 95-462963 95-857143 95-040000 
Xs 50-835165 51-148148 50-10 52-093333 
xy 133-000000 134-882716 133-642857 131-466667 
Table 6. Analysis of dispersion 
Dispersion 
‘Between’ (3 D.F.) ‘Within’ (394 D.F.) Total (397 p.¥.) 

zx? 123-180628 9661-997470 9785-178098 

x$ 486-345863 9073-115027 9559-460890 

2 100-411505 3938-320351 4088-731856 

z= 640-733891 8741-508829 9382-242720 

XI — 231-375635 445-573301 214-197666 

12s 87-305348 1130-623900 1217-929248 

1%, — 128-763994 2148-584210 2019-820216 

L_Xy — 107-505618 1239-221990 1131-716372 

Mo, 125-313318 2255-812722 2381-126040 

LyX — 137-580764 1271-054662 1133-473898 
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Example 4. Do the characters x, and x, show significant variation in the four series } 
independently of the variation due to the characters x, and x4? 
The method developed in § 4 (d) is directly useful in this problem. The s.P. matrix ‘within’ 
for the basic characters x, and 2, is 
W,, Wg) = (9661-997470  445-573301). 
( W, ( 445-573301 eareiisee} 
Its inverse is Wu W?\ = 10-*/ 1-037332 —0-050942\. 
(it wil ( Gaaaes i tele) 
The ‘within’ s.p. matrix for x5, x, due to 2,, 2, is given by the triple product 
Wi, Was\(W! W\(W, Ma 
(i wi) (iv ws) (i mi) 
= /1130-623900 1239-221990\(W"™ W*\(W, Wa 
(ics tease asus ble we) ing = 
= 10-*/1109-703904 1311-321492\ /(W, Wa 
(scssietbais sul ihides) = = 
= ,287-967620 534-238796)\. 
(34-238796 > stony 
The ‘within’ s.r. matrix for x, and x, after correcting for x, and 2, is 
Wes Waoe\— (Wis Was (WW) Wy Wy 
(ie m,) (i wi) (ir W x) (2 wi) 
= (3938-320351 1271-054662\ — /287-967620 534-238796 
(conresiieis warednant besiseuvae wena) 
=  eigcitine ba uevia = W(2| 2). 
736-815866 7749-887788 
This has 394—2 = 392 degrees of freedom. Similarly S(2|2) with 397-2 = 395 degrees 
of freedom is 3809-335190 611-798381)\, 
‘ 611-798381 abd rechia) 
_ | W(2|2)| _ 0-27746934 


wil | S(2|2)| — 0-31600332 





= 0-878058, 





V=—mlog,A, m= n—Ptatt “ sop T8 +" 


= 392, 

V = —392 log, (0-878058) = 51-39. 
This value of V on pq= 6 degrees of freedom is highly significant so that 2, and x, may be 
considered as cliscriminating the series independently of x, and 24. 

Example 5. Taking the relative times between the series in the proportion 2: 1:2, can the 
variation of the characters be accounted for by the linear regression of individual characters 
with time? 

In order to obtain the regression with time the values of ¢, the time variable, may be taken 
as —5, —1, +1 and +5 for the individuals of the first, second, third and fourth series , 
respectively. The calculation of individual regressions involves the quantities 

X(t—#)? = 4307-66832, 
Lz,(t-i)=  718-76286, LXzx,(¢t—#) = —410-10194, 
Xax,(t—t) = — 1407-26075, <Xz,(¢—é) = — 733-42758. 





ad 


; 
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The matrix R with 1 degree of freedom giving the squares and products due to regression 
is given in Table 7. 


Table 7. Matrix R with | degree of freedom 





ry 


a) 


23 


% 





vy 
a 
3 
vs 


119-930358 

— 234-810812 
68-428235 

— 122-377258 


— 234-810812 

459-734449 
— 133-975163 
— 149-601596 


68-428235 
— 133-975163 
39-042852 
— _ 69-824358 





— 122-377258 
— 149-601596 
— 69-824358 

124-874099 




















1 In the above table 
Ry, = [Za,(t—-#)P/Z(t—-#)?, Ry, = [Za,(¢—-¥)] [Ex_(¢—-Z)]/Z(t—-#)?, 
and so on. With these results one may analyse tle dispersion of which a typical product 
(2, %g) is chosen below for illustration. 


Table 8. Analysis of dispersion 





Due to D.F. S.P. matrix (2, 2%.) 





Regression 1 


— 234-810812 
*Deviation from regression 2 


3-435177 


(Ri) 
(Qi) 





Total (‘between’ series) 3 


— 231-375635 
‘Within’ series 394 


445-573301 


(Rg + Qs) 
(Ws) 





Total 397 


214-197666 (S,;) 
Deviation from regression + ‘within’ 396 


449-008478 (Q,;+ Wy) 

















* This quantity is obtained by subtraction. The complete matrix (Q;;+ W;;) obtained by the above 
method is given in table 9. 


Table 9. Matrix (Q,;+ W,;) with 396 degrees of freedom 


y be 


i the 
sters 


uken 
eries 





vy 


Xe 


3 


ba | 








L 


9665-247740 

449-008478 
1149-501013 
2142-197474 





449-008478 
9099-726441 
1265-691535 
2231-524444 





1149-501013 
1265-691535 
4049-689004 
1203-298256 





2142-197474 
2231-524444 
1203-298256 
9257-368621 








To test the hypothesis that the regressions are linear one has to compare W and Q+ W. 





A 


V 





40-02. 


|W] 024269054 x 10% 

“ = 0-90307436 
[Q+ W] ~ 0-26873816 x 19% — "90807436, 
a {3096 = aoe log, (0-90307436) 
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The x? approximation has p x q = 2x 4 = 8 degrees of freedom, since Q has 2 degrees of 
freedom and there are four variables. The result is significant so that the regressions cannot 
be considered linear. 

This test can be extended to examine whether a parabolic regression with time can explain 
the differences in mean values. The matrix Q giving the deviation from regression has then 
1 degree of freedom and R due to regression 2. 

To determine the coefficients of a linear compound which characterizes most effectively 
the secular changes in progress, Barnard maximized the ratio of the square of unweighted 
regression of the compound with time. It is doubtful, as Bartlett (1947) points out, whether 
such a linear compound can be used to specify an individual skull most effectively with 
respect to progressive changes, since linear regression with time does not adequately explain 
all the differences in the four series. 

The variance ratios obtained in this paper in the case of twe samples can also be 
derived from a general regression analysis by considering certain pseudo-variates, which 
have constant values for members of the same sample, as dependent variables and the 
observed values as independent variables (Bartlett, 1939; Fisher, 1940; Brown, 1947). 
Such an approach does not seem to be possible in the case of a single sample. On the 
other hand, the statistics defined in (2-1) and (2-2) can be used in any situation where 
there are a number of linear hypotheses to be tested with the use of the estimated 
deviations and their independently estimated dispersion riatrix. The distribution of the 
statistic in (2-2) has been derived by the author (Rao, 1946) under these general conditions. 


I wish to thank Dr Wishart for his helpful criticism during the preparation of this paper. 
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ALTERNATIVE SYSTEMS IN THE ANALYSIS OF VARIANCE 
By N. L. JOHNSON 


1. It is the purpose of this paper to compare the fundamental theoretical set-ups implied 
by certain well-known systems of approach to the analysis of variance. Differences in 
interpretation in the different systems are discussed, and attention is drawn to some par- 
ticularly simple results in the theory associated with one of the systems. No attempt is 
made to place the systems in any order of general preference. It is the author’s opinion that 
each has its own sphere of application, while consideration of problems from the viewpoints 
of more than one of the systems will often prove enlightening. 

2. The power functions of tests used in the analysis of variance have been considered by 
Hsu (1941), and by Tang (1938) who has given tables by means of which the power may be 
evaluated numerically in certain cases. 

In the particular case of testing for differences between k groups, the theoretical set-up 
used by these authors is 

Xi = Be+2; (s = 1,...,8; 9 = I, ...,%,), (1) 
where x,; corresponds to the jth observation in the ith group. B; is a constant representing 
the expected value in the ith group and the z,,’s are independent random variables, each 
with zero expected value and standard deviation oc. 

The appropriate analysis of variance is: 


Degrees of 
Source Sum of squares freedom Mean square 
k 1 ¢ 
Between groups = n(%;.—Z,,)? k-1 ——— in,(%,;.—Z..)? 
i=1 k—1 j21 
km 1 km 
Within groups x =X (x,;—%;.)? N-k —— = = (x,;-—%;.)? 
i=1j=1 N—k j=1j=1 


k ni 
where N = >'n; is the total number of observations; %; = nz} > x;; is the mean observed 
i=1 k j=1 

value in the ith group; 7, = N-! }\n,%,_is the mean of all the observed values. The expected 


i=1 
1 & rs 
value of the between groups mean square is 0? + ae >, B;-—B)*. The expected value of 
— tin 
* k 
the within groups mean square is 0°. (z = N15 0, B; ) The ratio 
i=1 


(between groups mean square)/(within groups mean square) 


is used to test whether there is any difference between the B,’s. If there is no such difference 
the expected values of the numerator and denominator of the above ratio are each equal 
to o*; otherwise the expected value of the numerator is greater than o°. 

If it be assumed that each of the z,,’s is normally distributed, the ratio of the mean squares 
will be referred to the F distribution with degrees of freedom v, = k—1, v, = N—k. Large 
observed values of the ratio are regarded ~s significant. A suitable upper significance limit 
of the appropriate F distribution may be sed as a formal critical limit for the mean square 
ratio. Tang showed that, for such a test with alternative hypotheses specified by (1) above, 
the power (i.e. the chance of establishing significance when the B,’s are not all equal) depends 
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k os 
on k, N and, say, 6 = (k—1) ¥n,(B;—B)*/o? only. The power function is somewhat 
i=1 


complicated in its mathematical expression, but Tang’s tables make it possible to determine 
the chance that a given ratio 0 would be established as significant at either the 5 or 1 % level. 

3. The alternative approach described below involves a modification in the theoretical 
set-up and leads to a very simple form of power function in a particular, but common, case. 
Although the modification may not always be justifiable, it will often provide a more 
accurate model than set-up (1), apart from the greater simplicity in the resulting analysis. 

This alternative form of thecvetical set-up is constructed by replacing (1) by 

Xz = A+%+%;, (2) 
where A is a constant and the z;’s are independent random variables, each with expected 
value zero and standard deviation o’. The z;’s and the z,,;’s are also mutually independent. 
In (2) the constants B; of (1) are replaced by the random variables A + z;, and the hypothesis 
B, = B, =... = B, is replaced by the hypothesis o’ = 0. 

It is evident that (2) is a suitable set-up if it is possible to regard the groups as being chosen 
at random from a large assemblage of groups. If the groups are fixed, (1) will be preferable. 
Sub-sampling by batches from a randomly selected sample of batches is a typical example 
where (2) is suitable; comparison of a number of distinct treatments of a material is a typical 
example where (1) is preferable. Set-ups (1) and (2) represent extreme cases. In general it 
is likely that an intermediate set-up of form 

%; = B,+2%4+2;; 
would be most appropriate. Daniels (1939) and Eisenhart (1947) have discussed, in some 
detail, the factors affecting the relevance of set-ups (1) and (2) in any particular problem. 

However, the same analysis of variance is suitable in both extreme cases and so is likely 
to be suitable for any intermediate case. In fact, under the assumptions summarized in (2): 


k 

The expected value of the between groups mean square is a+0°(N 2_> n?) / N(k—1). 

i=1 

The expected value of the within groups mean square is o®. The ratio 

(between groups mean square)/(within groups mean square) 
is again suitable for testing the hypothesis o’ = 0. If it be assumed that the z,;’s are normally 
distributed, the F significance limits may be used as described in § 2. 

4. If it now be assumed that the zj’s, as well as the z,,’s, are normally distributed, it is 
possible to obtain the power function in the case n, = n, = ... = my, = n, Say, in a particularly 
simple form. From (2) it follows that 

n 
%,,=A+z,+2, where 2, =n "> 2; 
j=1 
=A+uU; where wu; = 2;+2,. 

The u,’s are independent normal variables each with expected value zero and standard 

deviation ,/(n—1o? + o’2). The between groups sum of squares is 


k k k 
dn(z%;.-z% _)? = Hn(u;—u)? where w= k">u,, 
i=1 i=1 i=1 
and hence is distributed as y*(a? + no’®) with degrees of freedom v = k— 1. The within groups 
sum of squares is kon mS kon a 
xX UVey-*% P= =X (23 —2;.)*, 
imlj=l i=1j=1 
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and is distributed independently as x20? with v, = k(n —1) degrees of freedom. Hence the 
mean square ratio used in the analysis of variance test is distributed as 
Fx (= + i} 
o 
with vy, = k—1, v, = k(n—1). 
If F,, the upper 100a % point of the F distribution, be used as a formal critical limit, the 
probability of rejection of the hypothesis o’ = 0 is 


Pr. {r(= i) > r,| = Pr {PF >F (1 + we) -* (3) 


This is the power of the test with respect to the alternative hypothesis specified by (2) 
and a particular (non-zero) value of o’. When o’ = 0 the probability of rejection is «. As o’ 
increases F,(1+no’2/o?)-! decreases and the power increases. The expression (3), considered 
as a function of o’, is the power function of the analysis of variance test in this case. 

It will be noted that the power function is a function of no’?/o*. This is sion tae to 





the fact aor with set-up (i) the power function is a function of (n/(k—1)) )s (Bs; — B)?/o?. 
o’? and 7 (B;—B)?/(k—1), indeed, fulfil similar roles in the two systems. 

5. The alaediilid of the power function from (3) is straightforward. Since 
(k—1)#*—) [k(n — 1) ]e"—D - Pue-3) 

B3[k—1), $k[n—1})  [k(n—1)+(k-1) FO” 


it follows that Pr. {F > F,(1+no'?/o?)-} can be expressed as the incomplete beta function 


P(F) = 





wrt Tg(4k(n—1], $1), 
where = k(n—1)/{k(n—1)+(k—1) F(1 +20"? /0?)>}. 
When the number ie groups is odd and not large it is possible to evaluate (3) as a simple 

explicit function {(o’/o) of o’/o. For example if k = 3, 

p(F) = K,{§(n—1) + FO", 
where K,, = [3(n—1)}#@-, 
Hence A(o'/o) = [" p(F)dF 

wv F.(1+no"/o*)-* 

= Ki [3(n-1)+ F(1+n0?/o?) 1], (4) 
where Kj} = K,,/3(n—1) = [3(n-- 1)". 
Since | “(F)dF = a, 


K,[3(n —1)+ Fie» ae 


and so B(o' |) “a r= fon 1)+F, =|" (4) bis 





+ Fi(1+no"?/o?)- 


6. In many cases the hypothesis B, = B, = ... = B,, or the corresponding hypothesis 
in set-up (2), o’ = 0, is unduly stringent. That is to say, a test procedure is required which 
will lead to acceptance in a high proportion of cases provided there is not too much difference 
between the groups. It is natural to use as measure of the amount of difference between the 
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groups a parameter on which the power function depends. The parameter to be used would 
k — 
therefore be ¥,(B;—B)?/(k—1) in conjunction with set-up (1), or o’ with set-up (2). The 
i=1 


critical limit for the mean square ratio should then be chosen so that the chance of rejection 
is less than «,, say, for any value of the parameter less than some specified amount. 

It will also be desirable that rejection shall take place in a high proportion of cases—at 
least 1—a,, say—when the groups differ by more than a certain amount. That is, the test 
should have at least a certain minimum sensitivity. 

The requirements described above may be summed up formally as follows: 

(a) The power function of the test must be less than «, for all values of the difference 
parameter less than some known amount. 

(b) The power function must be greater than 1—«, for all values of the difference pere- 
meter greater than a second known amount. 

This type of problem occurs in the theory of statistical quality control, the limiting values 
of the parameter corresponding to ‘Producer’s Tolerance’ or ‘Process Average’ and ‘Con- 
sumer’s Tolerance’ or “Lot Tolerance’ respectively. 

Evidently, conditions (a) and (6) cannot both be satisfied unless the data available are 
sufficiently numerous. The amount of data required can be found from a study of the appro- 
priate power functions. Tang’s tables are useful in this connexion when set-up (1) is suitable. 
The analysis is much simpler for set-up (2) in the case we have considered in § 3 et seq. In the 
next section certain interesting results will be derived for this particular situation. 

7. It will be convenient to define the difference between the groups by the parameter 
o’ /o, instead of simply o’. It may be noted that o’/c is the ratio of a parameter representing 
between-groups variability to one representing within-groups variability, and so can be 
regarded as a measure of relative between-groups variability. We shall require the analysis 
of variance test to be such that 

(a) the probability of rejection is less than a, if o’/o <A,; 

(b) the probability of rejection is greater than 1 — a, if o’/o > Ag. 

In the limiting case when (a) is just satisfied, it is clear that the critical limit /, must 


be such that Pr. {F(1 + nA}) > Fy} = a. 


Hence F, = F,, (1+ Aj), F,, being the upper 100a, % point of the F distribution with 
vy, = k-1, v, = k(n—1). 
If condition (6) is also to be satisfied we must have 
Pr. {F(1+nA3) > Fj} > 1—a,, 
i.e. Pr. {F(1 +A) > F,, (1+mAj)} > l— ag. 
F, 1+ndj 
Thi that a. <¢.___7, 
is means tha F.. < Ttnai 
F_,, being the lower 1002, % point of the F distribution with v, = k—1, v, = k(n—1). 
The choice of A,, Az, x, and a, will depend on practical requirements. Once these are decided 


upon, the number of groups, &, and the number of samples per group, , should be chosen 
so that (5) is satisfied, if possible. 


Imagine k fixed, and consider the effect of increasing n. As n increases the ratio F, IF, 
decreases steadily, approaching the limit x3, / Xi-as as n approaches infinity. (x2, and y7_,, 
represent the upper 100a, % and lower 100%, % points respectively of the x* distribution 

6-2 





(5) 
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with (k— 1) degrees of freedom.) As n increases the ratio (1 + mA3)/(1 + nA3) increases steadily 
from 1 to (A,/A,)?. If x2, /x7_., is less than (A,/A,)* there will be a number 7, such that if 
N% >» condition (5) is satisfied. If x2, /x?_., is greater than (A,/A,)*, on the other hand, it 
will not be possible to satisfy (5), however large n may be. x2, /x3_., is a decreasing function f 
of k, approaching 1 as k tends to infinity. There will therefore be a minimum number of 


groups, ky, below which it is impossible to satisfy (5). A short table of such minimum values 
is given below. 











a, = a, = 0-05 a =a,=0-01 
A2/Ay ko Ag/Ay ko 
1-5 35 1-5 68 
2 14 2 25 
2-5 9 2-5 16 
3 7 3 12 




















It may be noted that if it is reasonable to assume that o is constant, A,/A, is the ratio of 
the ‘unacceptable’ to the ‘acceptable’ limit of between-groups variability. 

8. The alternative systems developed in §§ 2 and 3 are of use in the interpretation of the 
analysis of variance for data arranged according to a cross-classification. We shall consider 
only the simple case of a two-way cross-classification into | ‘rows’ and m ‘columns’, there 
being ” observations in each cell. The symbol z;,, will be used to denote the tth observation 
in the cell belonging to the ith row and the jth column. The analysis of variance table is: 


Degrees of 
Source Sum of squares freedom 
l 
Between rows mn & (%;..—%,,.)? l-1 
i=1 
™ 
Between columns In 3 (%5.-%,,.)® m—1 
j=1 
lm 
Interaction nX X (%5.—-%,.—-Zs.+%,,.)* (t—1) (m—1) 
i=1j=1 
'_ mn 
Within cells Xt & (typ —Fy,)* lmn—1 
i=1lj=1t=1 
” n ae: mn A  - 
where Ey =n Say, FZ. =(mn) > Vay, F535. = (NM)? dD Vriyp 
t=1 j=1t=1 i=1t=1 


t'imn 
%_ = (lmn)* YY Veg 
i=1j=1t=1 
The question now arises—should the ratio of the between-rows mean square to the within- 
cells mean square be used to test for differences between rows, or should the ratio to the 
interaction mean square be used? (A similar question arises, of course, in the analysis between 


columns.) The answer to this question depends on which of the two set-ups (6) and (7), 
shown below is the more appropriate. 


First, extending (1), we have 


hin- 
the 
veen 


(7), 


(6) 
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As before the z,’s are independent random variables each with expected value zero and 
standard deviation o. The parameter A is introduced to simplify the mathematics and 
represents the overall average level of the character measured. R; represents the average 
departure from this level in the ith row; C; represents the average departure in the jth 
column. Without loss of generality it may be assumed that 


I m 
DR; = =x; = 0. 
i=1 j=1 


[,; represents the interaction, or departure from the linear set-up, in the cell belonging to 
the ith row and the jth column. Without loss of generality it may be assumed that 


l m 
Lh; =0= rh. 
i=1 j=1 


The expected values of the various mean squares in the analysis of variance table are, 
under the conditions summarized by (6): 


Mean square Expected value 
z 
(i) Between rows o?+mn x R?/(l—1) 
i=1 
(ii) Between columns o?+ln 5 CF/(m—1) 
j=1 
: 
(iii) Interaction ind = I%/(l—1) (m—-1) 
i=1j=1 
(iv) Within cells ot 
It is clear, therefore, that the ratio of (i) to (iv) should be used to test the hypothesis 
R, = R, = ... = R, = 0 when set-up (6) is valid. As in the case of set-up (1), Tang’s tables 


can be used to calculate the power of the test to establish significance when there is a true 
effect. If the interaction mean square were used instead of the within-cells mean square we 
should risk reaching an inconclusive result when significance could have been established 
(ie. there will be an increase in the second kind of error). 

Now consider the alternative set-up 


Ki = A+R + C+ 25 +2 (7) 
formed by replacing the parameters J;; by the random variables z;;. The z;;’s are assumed to 
be independent of each other and of the z;,,’s, each having expected value zero and standard 


deviation o’. Under these conditions the expected values of the mean squares in the analysis 
of variance table are: 


Mean square Rixpected value 
I 
(i) Between rows o*+no?+mn & R2/(l—1) 
i=1 
me 
(ii) Between columns o*+no%+In = C3/(m—1) 
j=1 
(iii) Interaction ot+no" 
(iv) Within cells oe 
It is apparent that if the ratio (i)/(iv) be used to test the hypothesis R, = R, = ... = R, = 0 


when set-up (7) is valid, the numerator will tend to be increased by the o”* effect without any 
corresponding increase in the denominator. There’ would thus be a bias towards rejection of 
the null hypothesis (i.e. there will be an increase in the first kind of error). In this case, 
therefore, the ratio (i)/(iii) would be a preferable criterion. 
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In the case of a two-way classification, therefore, unlike the case of k groups, the two forms 
of theoretical set-up lead to different procedures in the analysis of variance. As before, the 
two systems, in this case (6) and (7), may be regarded as extreme cases. An intermediate 
set-up of the form Giy = A+R, +0, + Tey + 2g +2 
would possibly be a truer reflexion of the practical position. This being so, it may be as well 
to consider both the ratio with the within-cells mean square and that with the interaction 
mean square in the denominator. Since the biases introduced by using the inexact tests are 
in opposite directions it follows that if the verdicts given by both ratios agree, confidence 
may be placed in the joint decision. Otherwise, closer consideration must be given to the 
conditions of collection of the data, to decide whether (6) or (7) is the more appropriate set-up. 

Considerations similar to those developed above may be applied to more complicated 
problems in the analysis of variance. As a general rule, if an interaction is represented by 
a random variable, it is necessary to take it into account when testing interactions of lower 
order involving the same factors. Otherwise it is not necessary to do so. 

9. Randomization theory provides yet a third system of theoretical set-ups. The essential 
difference between randomization theory and the systems already described is clearly 
illustrated by comparison of the theoretical set-ups they imply in the case of simple classi- 
fication by groups. 

It is possible to apply randomization theory to such a situation only if it is reasonable to 
suppose that any individual in the sample could have occurred in any one of the groups. 
A typical case arises when the effects of a number of treatments are to be investigated. ‘The 
experimental material is divided into a number of groups and each group is assigned to a 
particular treatment. 

It is supposed that the experimental arrangements are such that each possible arrangement 
of the N individuals into k groups of size n,, no, ...,);, respectively is equally likely. The 
process of randomization in selecting the . -oups is an attempt to make practice consistent 
with the theory in this respect. The null hypothesis may then be expressed: ‘the observed 
value of the character measured will be the same for any one individual, whatever be the 
group in which it is placed.’ On the null hypothesis, therefore, there are only N possible 

observed values w,, ug, ..., Uy. Any observed set of values 2,,, ..., Xn, is simply a rearrange- 
ment of the w,’s. Since x,; is equally likely to have any of the N values w,, v2, ...,uy, the 
theoretical set-up on the null hypothesis may be written 
Vis = Yaz» (8) 
where y,; is a discontinuous random variable with distribution function 
Pr. {y,;=u,}=1/N (r =1,2,...,N). 
It will be noted that all the y;,’s have the same distribution, but they are not independent. 
If y;; = u,, then, in general, no other of the y;,’s can take the value u,. 

It has been shown (Fisher, 1935; Welch, 1937, 1938; Pitman, 19375 that in the simple cases 
of classification by groups and cross-classification considered in this paper the distribution of 
the mean square ratio on the randomization theory may be replaced by the normal theory 
F distribution with little fear of serious error. In these cases, therefore, rui:domization of an 
experiment ensures that critical limits based on normal theory shall be approximately valid. 


N 
If we denote u = N-! > u, by A, (8) may be written 
r=] 


Xi = A+Yi;, 
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where y;; = y;;— A. The yj,;’s are discontinuous, dependent random variables, each having 
the same distribution with expected value zero. Logically, alternative hypotheses, corre- 
sponding to the existence of differences between the groups, could be introduced according 
with either of the systems described earlier in this paper. Symbolically these would be 
expressed 
Xjy = A+ B+ y5;, (9} 
Liz = A+2z+ yiy. (10) 
(9) corresponds to set-up (1), and (10) to (2), so far as the representation of group differences 
is concerned. 
Set-up (1) may be written in the form 


yy = A+ Bi+2;,;. (11) 
(B; has been replaced by A+ B;, but this is merely a matter of convenience, and does not 
affect the nature of the set-up.) We also recall that set-up (2) is 
Hz = A+254+2%;. (12) 
Studying set-ups (9) to (12) we notice that while the set-ups (1) and (2) differ in the nature 
of between-groups variation which they specify, randomization theory implies a modification 
in the distribution of the individual random residual variation, replacing the independent 
z,; by the dependent y;,’s. 
Although four different set-ups are shown above, it seems that (10) would be used but 
rarely. The use of constant parameters to represent group effects appears to be more 
consistent with the ideas of randomization theory. 
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AN EXAMINATION AND FURTHER DEVELOPMENT OF A FORMULA 
ARISING IN THE PROBLEM OF COMPARING TWO MEAN VALUES 


By ALICE A. ASPIN, B.A., Leeds University 


1. IyTRODUCTION 


In a recent paper B. L. Welch (1947) has developed, by a formal process, an expansion applic- 
able to the problem of comparing two mean values. It is the purpose of the present paper 
(a) to extend this expansion to some further terms, (b) to investigate the numerical behaviour 
of the expansion in some particular cases and (c) to consider the comparative merits of 
a rearranged form of the expansion. 

If we have two normal populations with true means a, and a, respectively and true 
variances o? and o3; and if we have samples of sizes n, and n, drawn respectively from these 
populations, yielding sample means 7, and %, and sample variances s} and s3; then (%, — Z,) 
is distributed normally about («,—a,) with variance (o7/n,+03/n.), and s? and s3 are dis- 
tributed as x?c7/(n,— 1) and x303/(n.—1) respectively. Problems of some importance are 
either to assess the significance of the observed difference (%, — Z,), or to calculate as a func- 
tion of (%, — Z,), 8? and s3, limits within which the population difference (a, — ~,) may be said 
to lie with a given probability. In his theoretical discussion of this problem Welch has found 
it convenient to consider it as a particular case of the following more general problem which, 
formally, is no more difficult to solve. 


Suppose 7 is any population parameter, estimated by an observed quantity y which is 
k 
normally distributed with variance of = > A,o?. Suppose that, in addition, the data provide 
i=1 


estimates s? of the unknown variances o? (i = 1,2,...,4), based on f; degrees of freedom, 
and distributed as _g2\tfi-1 : 
p(s?) ds? = 1 (2) exp _1fisi i 3), (1) 
Tf, \20? 2 o W503 
where the s? (i = 1,2,...,4) are all statistically independent of each other and of y. Let 
h(s?, s3,..., 8%, P) be that function of s* and P such that the probability is P that (y—7) falls 
short of h(s?, s3,..., 8%, P). Then, if we can find h(s?, s3,...,s2, P) in general, the particular 
application to the case of the comparison of means will follow by setting k = 2, 7 = (~,—«,), 
y = (%,—Z,_); Ay = 1/n, and A, = 1/g. 
Writing, for convenience, h(s*) for h(s}, s3,...,8%, P), Welch has shown that the integral 
equation which A(s*) must satisfy can be expressed symbolically in the form 
h(w) 
Ol eren) ae (2) 
The notation used hefe is that J(v) stands for the integral, from — oo to v, of the unit normal 
probability function “ 


= bie. as 703 — eee a! 
mi)’ +etc., 

















(3) 
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where 0; implies repeated differentiation with respect to.w; and subsequent equation of 
all w; to a7. 

When the f; are all large, the solution of (2) is ho(w) = £./(2A,w,), where € is the normal 
deviate such that J(€) = P. More generally let us write 

h(w) = hy(w) + h,(w) +h(w) + etc., (4) 

where h,(w) includes terms of order 1/f;, h,(w) terms of order 1/f?, and so on. Further, suppose 


that we have calculated terms up to and including the order 1/f7 and wish to obtain an extra 
term h,,,(w). To the required order we may then write 


{ h(w) i al .- th,(w) +h,,1(w)) 











J(EA,03) VA.) 
__ sflig(w) + ...+1,(20)) , Iipga(w) [gl ) 
= i JA) + 3tikten! tear (6) 


When we operate on this with © the second term will, to the order involved, need to be treated 
only with the unit part of (3). Hence (2) will give 
ho(w)+...+h,(w)) . h,.,(07) 
el o ~— I'(é) = 1(€). 6 
Verne) |tyeaey © = 70) 9 


This equation gives h,, ,(0*) explicitly. Since h,,,,(w) is the same function of w, and h,,,(s*) 
the same function of s} as h,, ,(07) is of 2, we have therefore an explicit method of deriving 
successive terms in an expansion for h(s*). 





, . jho(w) +... +h,(w) 
Pursuing the symbolic method a stage further we may expand J : us 
wns, : pied VEX) 





formally in a Taylor series, thus 


ho(w) +... al ae ene +...th(w) _ 

i (24,03) = ex W(2A,%) £}D | I(x), (7) 
where D’ denotes repeated differentiation with respect to v and subsequent equation of 
v to £. The operation © in (6) may then be regarded as acting first on the exponential on the 
right-hand side of (7), producing an expression involving D which must in turn be operated 


on J(v). Following out this procedure, Welch (1947, p. 31) has obtained the following 
expressions as far as order 1/f?: 











(+22) (= “n) 
ho(s?) = Eql(ZA,s%), hy(s) = E(ZAz82) 











ts)’ 
Az s$ , A388 _Aksf\? 
ha(s*) = E/(ZA “- (1+ 8) 7) , B+ 5E+ 84) =) _asesep ogy (=F) 
sl a ME I» 3 (aAsi)s 32S (SAS 

(2%et) vs 
If we introduce the notation vy = & a (9) 
equations (8) may be more compactly written as 

h 2 
het) = EAD, Fe = 1+ E) Ma 
" : 


eee = [— (1 + £%) Vag + (3 + 5E2 + EA) Dog — dyp(15 + 32E2 + 9E4) V3]. (10) 
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2. THE DEVELOPMENT OF FURTHER TERMS f 


To find h,(s?) we must first extend equation (3) to include terms of order 1/f?. This gives 


ont (era) Pa) PEGE) ae a Ea) tPy, 





(11) 
This expression must operate on the exponential 
ho(w) +... +ho(w . { Ao(w) | D Jex p|{" uw) +s (v0) | | 
exp | ae = |p| - = 9 xp|{ (2A, oi) clp \(2A,o | I 
_— Tf /((eA,w,; ‘)- it hy{w) D biel: 1 hi(w) D° | 
—s Ha (sx a ; saat | ae 2) "2 (ZA,0%) 

{hy(w) h (wv) D? 1hi(w) dD }|- (12) 
(=A,o%) 6(ZA,o?)! 7 


h,(w) and h,(w) are already known and can be substituted in here. When this is done the 
successive differentiations required by (11) can be carried out and the first term on the left- 
hand side of (6) evaluated for the case (r + 1) = 3. This equation then gives h,(o?). The algebra 
involved is heavy and the details will not be given here. The eventual result is found to be 


2) 
aa = (1+ £8) Vag 2(8-+ E+ £8) Veg + 4(15 + 3282 + 9E*) Ma My 


o(8? 
+3(75 + 1732 + 634 + 5£6) ) Vag — Ps (105 + 298? + 140¢4 + 152%) HV, 

+ 3hq(945 + 31692? + 181124 + 243£*) V3). (13) 
The labour involved in calculating groups of terms of successive orders increases rapidly 
with r. This is due to the increasing number of differential operations introduced with each 
new term in the expansion of © and also to the rapidly increasing complexity of the expres- 
sion on which © operates. Hence, even for (r + 1) = 3, a very large number of differentiations | 

with respect to the w; have to be carried out before the final equation of all w; to oj. In ex- 

tending the work still further to the terms of order 1/f}, the present author found it necessary 


to cover over 100 pages with algebra, details of which need not now be given. The eventual 
result is found to be 


“ a -(- 2(1 + £?) Vag + 3R(3 + BE? + S4) Vay 
— }(15 + 328? + 9£4) VraVat + 4V3,} 
— (75 + 173? + 6324 + 5£%) VY, 
+ $(105 + 298E? + 140E4 + 158°) {$VagV go + Var Vos} 
+ }(15 + 33g? + 114+ £%) V,, 
+ 3(735 + 21702? + 1126£4 + 168£¢ + 728) Ki, 
— Ay (945 + 3169E? + 18114 + 24326) V,, V3, 
— zs(945 + 3354£? + 2166E4 + 42526 + 25E8) V2, 
— Pz(4725 + 16586E? + 10514E4 + 19746 + 10588) Nyy 
+ gg(10395 + 42429¢? + 31938E4 + 7335£¢ + 495£%) V. V3, 
— gizg(135135 + 6261442? + 542026E4 + 14532088 + 11583¢8) V§,]. 
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f 3. CHECKS 
3 As so much heavy algebra has been involved in reaching these results, greater confidence 
. [ will be placed in them if some independent checks are available. One possibility is to try to 
) . | find an expansion of some function of h(s*) rather than of h(s*) itself. It happens, indeed, 


that the square h?(s*) can be developed in terms of successive orders in 1/f7 by a similar method 
to that used above without involving quite as much labour. In this development the © of 
equation (2), instead of operating on a normal probability integral, operates on the integral 
of the distribution of the square of a unit normal deviate. The first approximation to h?(s*) is 
£2(ZA;,s8?) so that, analogously to equation (12), we find that © has to operate on the product 





of two factors of which the first is exp [exes Sey - i ep]. Since this does not contain a 

square-root sign, some of the labour of operating with © is lightened. A full check of 
(12) equation (13) using this alternative method has been carried out. 

A full independent check of the terms of order 1/f# has not been similarly obtained, but 

the a check which is almost as satisfactory is obtained by putting k = 1. We then find that (14) 
left- 
a settnoes to hq(s*) _ (—945—1920€? + 1482644 7768 + 7988) _ 
h,(s?) 360 x 44f4 ( 
» be . 


This agrees, as it should, with the term in 1/f4 in the expansion of the straightforward 

\ ‘Student’ deviate given by R. A. Fisher (1941, p. 151). It is difficult to imagine algebraical 
mistakes which could have been made in reaching (14) without invalidating this agreement 
in the particular case, k = 1. 


(13) | 
idly | 4. A REARRANGEMENT OF THE EXPANSION 
ack It will be seen on inspection of equations (10), (13) and (14) that h,(s*), h,(s*), hg(s*) and 
: = oo h,(s?) all contain a term having (1+ &?) as a factor. Grouping these terms together, the total 
ions =} —— : _ ; 

contribution to h(s*) from this source is 
| CX- 
sary HE (ZA, 87)} (1 + §*) {Var — 2Vog + 4¥ eg — 8V aq ---}- (16) 
tual | Further, we have 
































A? s$ Az s A2s4 Az sf 
XA; 83)? {Va, — Van + 4h — 8% j= (z : ‘)- 2(E r =) +4 L ‘)- a(2 ; ).. 
( ) { 21 22 23 2a°°°5 fi RR #R fi 
“eMO-ii-#-) 
AY AR 
A2 8} 
= (= 74). (17) 
Hence (16) gives a contribution to h(s*) which we may denote by h;(s®), where 
A? s$ 
1+ ( al 
| hi(s?) = E,/(Sa, 83) |! +e) a : (18) 
Other terms may be combined in a similar manner. Indeed, if we write 
(2 Agtis u+1) ) 
Ww Ait DG 4). Get 2u) si 


: Gay 
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we can rearrange the expansion of h(s?) in the form 


‘ h(s*) = ho(s®) + hy(s?) + hy(s?) + etc., (20) 
where now 

Wile) = EVA, Gia = KU+EM, 

Tay = (8-+ 58+ £4), — gel 15 + 9264+ 964) WH, 

hy(s?) 


i “a2 = [}(75 + 173E? + 63£4 + 5£) W, 
— zy(105 + 298E? + 14064 + 15£%) W, W, + gh4(945 + 3169E2 + 1811£4 + 243¢%) W3]. (21) 


The /4(s®) contribution does not come out completely in terms of the W,’s, but involves other 
expressions in addition. While this contribution cannot on this account be said to be anoma- 
lous, the best way of expressing it is not obvious and it is not proposed to enter into a 
discussion of it here. 

Going only as far as terms of order 1/f? it will be seen that, by using the W,’s, we have 
reduced the total number of terms in h(s*) from eleven to seven. Moreover, the saving in the 
number of these terms wiil be more marked as we proceed to higher orders of 1/f7. In certain 
circumstances, therefore, particularly if we are computing several probability levels simul- 
taneously, it seems that there might be some gain in using equations (21). However, the 


question of convergence must be considered before a statement of this kind can properly 
be made. 


5. NUMERICAL INVESTIGATION 


This will be confined to the case k = 2 which includes, in particular, the problem of com- 
paring two mean values. It will further be assumed that f, = f, = f, as would happen, for 
instance, in the mean value problem if the saniples drawn from the two populations were 
equal. (The common f would then be one less than the common sample size.) We are not, 
however, assuming anything about the relative sizes of the unknown population variances 
o? and 03. 

We shall confine ourselves here to a single probability level P = 95 %, so that £ = 1-64485. 


Let us then write j 
(dA,(6 a (z%0%) 
= =] + ae fa a 


7 ee) = 


so that H; and Hj are the successive approximations to h(s*)/é./(2A,s?), according as 
the original expansion or the rearranged form is used. The H’s depend on the observed 
data only through the ratio s?/s3 or, equivalently, the ratio A, s?/(A,s?+A,s3). Numerical 
values in Table 1 are given against this latter ratio for f = 6, 12 and 18. The argument of 
A, 83/(A, 8? + A, 82) is by tenths from 1-0 to 0-5 (the values 0-4 to 0-0 follow by symmetry and 
are not therefore shown). 

Considering first the expansion in powers of 1/f;, the degree of accuracy obtainable is seen 
from a comparison of H, and H,. When A, s?/(A, 8? + A,s2) equals 1 (or 0) we appear to have 
four decimal places accurate when f = 6, and five decimal places when f = 12 or more. In 
this extreme case h(s*)/é ./(ZA;s?) is a simple ‘Student’ deviate divided by ¢. We already 
know, of course, that the series representation of such a quantity converges rapidly (e.g. 
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: Fisher, 1941). In the final column of our Table 1 we give for comparison the values of ¢/£ 
0) calculated from Mrs M. Merrington’s table of the percentage points of ‘Student’s’ ¢ 


(Merrington, 1942). 

In the remainder of Table 1 we have no similar independent source against which we 
can make any checks and can only be guided by the relative sizes of the H;. [t will be seen 
that, as we move towards the middle of the range of A,s?/(A,s?+A,s3), the difference 
between H, and H, tends to increase. As a result it appears that the accuracy available at 
A, 83/(A, 83+ Ags?) equal to 4 is two decimal places for f = 6, three decimals for f = 12 

t and four decimals for f = 18. The accuracy improves towards each end of the range of 
21) Ay 83/(Ay 8} + Ags}). 






















































































1er ' Table 1. Successive approximations to h(s*)/é ./(ZA;s?) 
at (k=2, fi=fe=f, P=95%, £ = 1-64485) 
; f = 6 
we r,s 
the eta 
ain A, Hy, Hy A, Ey Hy Hy tp/E 
ul- 
the 1-0 1-1544 1-1784 1-1812 1-1814 1-1158 1-1334 1-1266 1-1814 
rl ) 0-9 1-1266 1-1478 1-1524 1-153 1-0949 1-1125 1-1101 — 
rly 0-8 1-1050 1-1176 1-1217 1-1248 1-0787 1-0926 1-0930 — 
0-7 1-0895 1-0924 1-0917 1-0934 1-0672 1-0765 1-0771 _ 
0-6 1-0803 1-0761 1-0698 1-0668 1-0602 1-0659 1-0656 —_ 
; 0-5 1-0772 1-€703 1-0616 1-0559 1-0579 1-0623 1-0615 —_ 
ym - - 
for 
ere f=12 
10t, \ A, 8 
‘aie 1,8 +A,8 
Hy, Hy, Hy A, Hy Hy Hy tp/E 
85. ! 
1-0 1-07720 1-08319 1-08354 1-08355 1-06617 1-07496 1-07600 1-0836 
0-9 1-06330 1-06861 1-06919 1-06923 1-05426 1-06221 1-05356 — 
0-8 1-05249 1-05564 1-05617 1-05636 1-04500 1-05111 1-05242 _— 
(22) 0-7 1-04478 1-04552 1-04544 1-04555 1-03838 1-04253 1-04339 —_ 
ai 0-6 1-04014 1-03908 1-03829 1-03810 1-03441 1-03713 1-03747 —- 
0-5 1-03859 1-03687 1-03578 1-03542 1-03308 1-03528 1-03541 — 
; as | 
ved f =18 
‘ical A, 8? 
t of Ay 8} + Ags3 : 
cil H, H, H, H, Hi Hi H; tp/t 
} 
seen 1-0 1-05147 1-05413 1-05423 1:05423 1-04632 1-05130 1-05219 1-0542 
0-9 1-04220 1-04456 1-04473 1-04474 1-03799 1-04238 1-04324 —_— 
lave 0:8 1-03500 1-03640 1-03655 1-03659 1-03150 1-03485 1-03557 — 
. ‘ 0-7 1-02985 1-03018 1-03015 1-03017 | 1-02687 1-02915 1-02961 —_ 
ail 0-6 1-02676 1-02629 1-02606 1-02602 1-02409 1-02561 1-02584 _ 
aay 0-5 1-02573 1-02497 1-02465 1-02458 1-02316 1-02440 1-02451 _ 
(e.g. 
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Turning now to the rearranged form of the expansion we notice immediately that at the 
beginning of the table Hy does not compare favourably with Hj, since the value of H; is not 
close to t/&. 

As we leave this end of the table the numerical differences between H; and H, decrease. 
It appears moreover, from an examination of the relative sizes of Hj, H, and H3, that in the 
vicinity of the value of A,s?/(A,s?+A,s3) equal to 4, the rearranged expansion converges 
more quickly than the original one. There does not, however, seem to be a sufficiently strong 
case for systematically abandoning the original expansion everywhere in favour of the 
rearranged form, even although the latter involves fewer terms. 

The present numerical investigation is a preliminary one and other possible rearrangements 
of the expansion are being considered before any general suggestions for computing tables 
of h(s*) are finally made. It will, perhaps, best summarize the work to the point reached if 


Table 2. Values of h(s?)/,/(A,8? + A,s2) and equivalent F 









































h(s?)/,/(A, 8? + A,s3) for Equivalent F for 
A, 8} sala pyre 
| Ast + Agee oT ry vere sare ; 
f=6 f=12 f=18 f=6 f=i2 f=18 
T3A7%) it oe 
| 10 1-9432 1-7823 1-7341 6 12 18 
| 09 1-897 1-7587 1-7184 6-9 14-3 21-7 
| 08 1-85 1-738 1-7050 8-3 17-4 26-3 
| 0-7 1-80 1-720 | 11-6945 il 21 32 | 
| 06 1-75 1-708 =| 1-687 15 | 25 37 
. 1-74 1-703 | (1-6853 17 oo 39 
| | 





we present again compactly in Table 2 the final result, H,, for all the cases considered. A slight 
modification may be made at this stage, by multiplying through by & so that the quantity 
tabled is now h(s*)/,/(ZA;s3). The quantities in the first line of the table are then the ‘Student’ 
deviates for f = 6, 12 and 18. Only as many decimal places are given as appear to be justified 
by the behaviour of the successive terms in the expansion. 

Although h(s?)/,/(2A;s?) cannot, beyond the first line of the table, be derived by noting 
that some quantity follows a simple ‘Student’ distribution, it is nevertheless of interest to 
consider what degrees of freedom F, say, a ‘Student’ deviate would have to possess if it 
were to have the same percentage points as the values of h(s?)/,/(ZA,s?) given. Accordingly 
we have shown these equivalent F’s in the last three columns. These values of F enable one, 
perhaps, to appreciate better the trend of the figures given in the earlier columns. 


6. APPLICATION TO THE COMPARISON OF TWO MEANS 
The quantity h(s?) was defined in the first section to satisfy the relation 
Pr. [(y—79) < h(s*)] = P, (23) 


h(s*) is, of course, a function of P as well as of s?, s3, ...,s% and should, perhaps, have been 
denoted by A(s?, P), but h(s?) was used throughout to save a little trouble in writing. The 





(23) 


been 
. The 
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dependence on P is understood. Turning now to the particular case of comparing mean 
values we must, as has already been noted, set 


1 





= (%,—Z,), 9 = (a —%), comet eet f= (n,— ), f.= (n,—2), (24) 
where n, and n, are the respective sample sizes. Then (23) becomes 
Pr. [{(% —%_) — (@, — &)} < h(s*)] = P. (25) 
If we write v= (i= 73) = (41 —49)} (26) 
am 8 
—s a ae 
N, Ne 
on h(s*) ‘ 
25) becomes Pr. ay (nett tea |7?P (27) 


The numerator of vis normally distributed about zero with variance (03/n, + o3/n,). The quan- 
tity under the square-root in the denominator of v is an unbiased estimate of (o?/n, +03/n,) 


since sj and s} are respectively unbiased estimates of o? and o3. The ratio v is, in general, 
to be distinguished from the quantity 


ee {(%, — Z_) — (a, —a)} 
| er bste a(t TW (28) 
(nm, + 2-2) ‘Ny Ns 


which would be the appropriate one to use if it could be assumed that o, = o, = 7. The 
ratio wu would then be referred to the é-distribution with (n,+,—2) degrees of freedom. 
If u is referred to the t-distribution when, in fact 7, +0, we are liable to be led into error, as 
has been shown by Welch (1938). These errors are not serious if the sample sizes are equal 
(n; = m, = n) for then u and v are the same quantity. Such error as there is is then due to 
referring u (or v) to the ‘Student’ distribution with 2f = 2(n— 1) degrees of freedom when, 
in fact, as we have seen, the appropriate percentage point depends to some extent on the 
observed yy: 8,/8_. The critical value of v will be read off from a table like Table 2, entering 
with f = (n—1) and with the ratio of s?/n to (s?/n + s3/n). 


To the a particular example, suppose that n, = x, = 7 and quantities Z,, Z,, s, and s, 
are observed such that 








- 7 ‘ 
%,—%_,= 3-7, 4/(8?/7+3/7) = 1-2, a ai i = 0-64. (29) 


Then entering Table 2 with f = 6 and the ratio 0-64, we have 
h(s?)/,/(Ay 83 + Ags?) = 1-77. 


If now we wished to test whether the data were consistent with the hypothesis that «, = a, 
we could compare the numerical value of the ratio 3-7/1-2 = 3-1 with the significance level 
1-77; this, it exceeds greatly. On the other hand, if we wished to compute limits within which 
(a, — a) lies with given probability, we would have from (27) 


Pr. [{3°7 — (ce — a%q)}/1-2 < 1-77] = 0-95. (30) 
Whence, on rearrangement of the inequality 


Pr. [(a, — aq) > 3°7 — 2:12 = 1-58] = 0-95. (31) 
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Owing to symmetry, the corresponding value of h(s*)/,/(A,s?+A,s3) for P = 5% will be 
minus 1-77. Thus analogously to (30) 


pe [EA aal < - 117] = 00s, is 


whence Pr. [(@, —@g) > 3-7 + 2-12 = 5-82] = 0-05. (33) 
Combining this with (31) 





Pr. [1-58 < (a, — aq) < 5-82] = 0-95— 0-05 
= 0-90. (34) 


In this equation the limits calculated for («, — «,) are not limits given to us before the samy.'es 
are drawn, but depend on the observed sample statistics. The probability statement has the 
meaning usually attached to such statements when the method of inverse probability is not 
being used. At the earlier stage in equation (30) the same holds true. The numbers 3-7, 1-2 
and 1-77 entering into this equation are all functions of the sample statistics and the prob- 
ability statement is strictly about these functions and not about connexions between three 
pure numbers regarded as fixed and known to us before the samples were drawn. In principle 
the present procedure is exactly the same as that already familiar in those problems where 
the ‘Student’ ¢-distribution is applicable. The only difference in detail is that, in a ‘Student’ 
problem, the number 1-77 in (30) would be replaced by a tabular ‘Student’ deviate not 
dependent on the sample statistics observed. In the problem being considered in the present 
paper, we obtained the figure 1-77 by entering a table one of whose arguments was 
A, 83/(A, 8? + A, 83), so that the value obtained depended, although not very critically, on the 
observed ratio s,/s,. But the principle is really unaltered and the inversion of the inequality 
(30) proceeds in precisely the same manner as when we are considering a problem soluble 
directly by the straightforward ‘Student’ distribution. 

In the present example and in the numerical work of the previous section we have confined 
ourselves to the case k = 2 and then tof, = f, = f. In the problem of comparing two means 
it is when f, +f, that the need for calculations of the kind considered here is most apparent 
for then, as Welch (1938) has pointed out, the w and v of equations (26) and (28) are not the 
same criterion and the error involved in the usual reference of u to the t-distribution can 
be more pronounced. We have considered the f, = f, case here first, merely to simplify 
calculations in an initial numerical investigation. It is proposed in some future work to 
discuss numerically the case where f, +f, and to compare the merits of different ways in 
which final tables may then be presented. Some consideration will also be given to the case 


where more than two population variances and their corresponding estimates are involved, 
i.e. the general case k > 2. 
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ON THE POWER FUNCTION OF THE LONGEST RUN AS A TEST 
FOR RANDOMNESS IN A SEQUENCE OF ALTERNATIVES 


By G. BATEMAN, University College, London 


1. INTRODUCTION 


It has been suggested that the distribution of the longest run in a sequence of alternatives 
might be used with advantage in quality control work and allied subjects. Mosteller (1941) 
considered the case of runs above and below the median for a sample of even size and derived 
» formula for the probability of getting at least one run of a given length or greater when the 
umber of elements of each of the two kinds is the same. Thus, if the alternatives in the 
sequence are EZ and E£, he considered explicitly only the case of 2n elements, n of which are 
# and n of which are E. It is the purpose of this paper to deal with the slightly more general 
case of unequal numbers of elements of the two kinds and to consider (i) the distribution of 
the longest run under the hypothesis of randomness, and (ii) the power function when the 
alternative hypothesis is that of positive dependence in the sequence both for the simple 
Markoff chain and when the structure of dependence is more complex. In (ii) the conditional 
power function technique, as given by David (1947) for the distribution of groups, is used, 
and the two criteria, length of longest run and number of groups, are compared with respect 
to the same alternative hypotheses. 


2. DISTRIBUTION OF THE LONGEST RUN 


It will be assumed that there is a sequence of r elements, r, of which are EZ and r, of which 

are E, where r, +7, =r. Hy, the hypothesis to be tested, will be that the elements of the 

sequence are in a random order, and the criterion used to carry out the test will be the length 

of the longest run of either Z’s or E’s. The total number of sequences which can be formed 

from the r elements is ’C,, ; this is the fundamental probability set. In order to pick out from 

this set the sub-set of sequences containing at least one greatest run of a given length, say g, 

it will be necessary to consider the partitions of r, and of r, having k as the greatest part, 
where k = 1, 2, ...,g, and to find the number of ways in which they can be combined to form 
a sequence with at least one part equal to g and no part greater than g. This may be achieved 
most simply, perhaps, by considering the different ways in which such partitions of r, and 
r, form 2t or 2¢+1 groups, where ¢ = 1, 2,...,r,-—g+1 for r,>r,. There will be no loss of 
generality in assuming 7, >73, and it will be understood in what follows that r, > rq. 

Let f,(¢, k), where i = 1, 2, denote the number of compositions* of r; elements into ¢ parts 
of which the greatest part contains k elements. This can be expressed in terms of binomial 
coefficients by using the result that the number of compositions of r; into ¢ parts, none of 
which exceeds s in magnitude, is the coefficient of x in the expansion of (x+2*+... +25}, 


: 1—2°\f ; a ss! , , Bo ge 
ie. of o(—*) . This coefficient is ¥ (—)/'C;"**“1C_,, and expressing it in terms of the 
- je 


abov : , , t 
above notation we have S filtsk) = ZS (—)Gr-G,_,. (1) 
k<s j=0 


* Compositions of a number are merely partitions of a number in which the order is taken into 
account. 
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100 Power function of the longest-run test 
It follows immediately that 


t 
Silt, 8) = >! as yu {O,[r*-1e--1C,_, —_ n-is-1C)_,]. 


If N(2t,g| 77.) denotes the number of sequences of 2¢ groups when at least one group 
contains g elements and no group contains more than g elements, then 


N(2t,g | 172) = af ft 9) & halt, k)+folt, y= ite X)| : (2) 


The factor 2 is introduced to allow for the fact that the sequence may begin with E or with E. 
In the same way it may be seen that 


k<g— 


N(2t+1,g|ryr2) = [ Ae+ 1,9) & Salt, k) + falt9) >» filt+ 1,1) | 


+| Alt.) 3 Alt+ 1+ e+ 19) > filet) |. (3) 
k<g k<g-1 


As it will be required later, A(t, ¢,,g) will be used for the expression 
Silty, 9) & falta, *)+folte.9) X filt:,*) provided that |t,—t,|<1. 
k<g k<g-1 


Thus N(2t,g|ryr2) = 24(t,t,g) and N(2#+1,g|ryrz) = d(t+1,t,9)+(t,t+ 1,9). 
The enumeration of the required subset is completed by summing N(2t,g|r,r.) and 


N(2t+1,g| 772) over all groups, i.e. from ¢ = 1 tot = r,—g+1. If the number in this subset 
be denoted by N(g| 7,72), then 


™-—9+1 
Neg |rirs) = (26(tst,9) + 9+ 1,,9) + $(6st+ 1,9). (4) 


Hence in a sequence of r elements, r, of which are FZ and r, of which are E where r, +r, =r 
and r, >7,, the probability that the longest run consists of g elements is 
N(g | ryr 
Piy|nrg ~Meln, 
T1 

and the complete probability distribution of the length of the longest run, given r, and rg, is 
obtained by letting g take all possible values. Values of the function (4) for r = 10 to 15, and 
r = 20 are given in Table 1 ; values of the functions (2) and (3) for r, = 14, r, = 6, illustrating 
the form of the correlation between 7’, the number of groups, and g, are given in Table 2. 

If, as is frequently the case in statistical applications, we require only the probability of 
the longest run having a length greater than or equal to a given value, say go, it will be con- 
siderably simpler to calculate 5 (t,,t,,g) directly; for using result (1) it follows that 

920 
2 ty 
X P(t» tas 9) = "C1", 1 — I ( & (—)8C; reHor-0-1G, for |t,—t,|<1 
920 i=1 \j=0 
=0 

and for brevity we shall write (¢,, t., 9 > 9) for this expression. , 


The probability that the length of the greatest run, g, is greater than or equal to g, is 
immediate, for 


P(g >9o|17172} = 2) P{g | 7173} 


for |t,—t,|>1, 


l Ti-Oot+1 
=z 2 (28st 9 > 90)+ BC+ L tg > 96) + Bit + 2.9290) |. 
Lat = 


| 
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In the same way ‘ 


P(g <go| 7173} = al2 (2G(t,t, 9 <go) + 9(t-+ Ling <ad+étut+ oo) 


sents Gus me 






























































where ssh 
oup Pty te, 9 < Jo) = = P(t, te,9) = i (= (=) MC, toe30,_) for |t,—t,|<1 
900 = = 
=0 for |t,—t,|>1 
(2) and a= [ te=*). 
Yo 
hk. 4} Table 2. The joint distribution of T and g for the case r, = 14, r, = 6 
(T = number of groups in the sequence) 
b ow | 14| 13 | 12] 1 | 10 | 9 s 7 6 5 4 3 | 2 | Total 
(3) 2 2 7 2 
; 3 5 2 2 2 2 2 2 1 18 
4 20 20 20 20 20 20 10 is . ; 4 . 130 
5 A 20 35 50 65 80 95 100 60 15 ° F ‘ 520 
6 - : 60 120 180 240 300 360 240 60 7 ; . 1560 
7 30 100 210 360 550 780 900 610 100 ~ = 3640 
8 ‘ . ; 80 240 480 800 1200 1560 1160 200 . < 5720 
9 ; : 20 110 320 700 1300 2140 2590 1350 50 = 8580 
and | wr. : ; ‘ 50 | 200 | 500 | 1000 | 1750 | 2300 | 1300 | 50 | . | 7150 
‘beet r | ll . P . ‘ 5 50 200 550 1225 2255 2410 455 . 7150 
12 : ; ‘ ‘ . 12 60 180 420 810 912 180 " 2574 
| 13 . : . " , . 7 42 147 392 735 392 1 1716 
©. oi 
Total | 7 42 | 147 392 882 | 1764 | 3234 5523 8442 10192; 7007 | 1127 i | 38760 
“hod ' 
It may be noted that if longest runs of the E’s only are considered then (2) and (3) reduce 
) to 2f,(t,g)"—1C,_, and f,(¢+ 1,9)" "C,_, +f, (t, g) "= *C, respectively. 
If 9, be used to denote the length of the longest run of Z’s in a sequence, then 
° 7,—s+1 
> a Nig = s\n} = S Alt.) IG 2+ 2G +97] 
, an - 


° m1,—8s+1 
ating = 2 fAlt.sy™nG, 


le 2. 
‘ t f r,—8s+1 t ; i 
ity O and Nr >8 | 1119} a > ret) > (- yn 'C; n-e-1)-1C._.. 
> con- t=1 j=1 
Writing 'C;"*1C, = "+10;"-i+1C,_;, interchanging the order of summation and using the 
m 
relation that } "C,.,,"C; = ™+"C;,,,, we have that 
i=0 
: 1 [in/s) é 
: P(x >s | r re} = 7 > (- yt ratl(, #6, | ‘ 
J j=1 
This result will be referred to in § 9. ie 
> Jo is 


3. CONDITIONAL POWER FUNCTION FOR THE SIMPLE MARKOFF CEAIN 


It is clear that the length of the longest run may he used as a criterion for testing randomness 
in a sequence in the same way as the number of groups or runs. If a longest run of length g, 
be observed, then, as shown in § 2, the probability of obtaining a run of length greater than 
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or equal to gp, or of length less than or equal to go, can be found. If either of these probabilities 
is less than some arbitrarily assigned significance level, then we may reject Hy, the hypo- 
thesis of randomness. But the possible alternative hypotheses will be different if we judge 
on the upper tail (i.e. for g large) or the lower tail (i.e. for g small). When the observed gp is 
so large that the hypothesis H, is rejected, then a possible alternative hypothesis, H,, might 
be that there is positive dependence of some kind in the sequence; that is to say the elements 
are not independent and given that EF hac occurred it becomes more likely that it will occur 
again. On the other hand if the observed g, is small, then a possible alternative hypothesis 
might be that there is negative dependence in the sequence. 


Consider a sequence of possible events ¢,, €g, ...,€, Which may or may not be independent; 
it is well known that 


Pfe,e,...¢} = Il Pe, | eye... &;_1}- 
i= 
If the events are independent then the relation reduces to 


Tr 
Pfe,e,...¢,} = Tt Pfe,}. 
This is the basis of H,, the hypothesis of randomness. 5 


If there is dependence as in a simple Markoff chain, each event will be dependent only on 
the event immediately preceding it, and we shall have 


Piey eg --- e} = Tt P {e; | ¢:-a}- 


This is the basis of H,, the possible alternative hypothesis to H,, and we shall take into account 
only the case where the dependence is positive. a 

Now consider a sequence of r events composed of alternatives HZ or H, and let L; denote 
the happening of the event E at the ith trial. H, and H, will be as above with capital letters 
replacing small ones. Under the binomial hypothesis, i.e. under Hj, we write 

P{E3}=p and P{E}=q for i=1,2,...,r, where p+q=1. 
and we shall have 
N(g\ 7,72) p"1q"2 N(g\ 117s) 
P{g | 1r,r2H,} = (g | 1 2) pg" al (g | 1 3” 


= NGgl|rir)p gq C,, 
allg 


The hypothesis, H,, is rejected if g >g, where 
Pg > 9a| 7172 Ho} = &, (5) 
and g, is chosen so that @ is as near as possible to the chosen significance level. Such values 


of g, are shown in Table 3 for r = 10, 15,20, and « in the neighbourhood of 0-05. This 
table could clearly be extended if desired. 


As a likely alternative to H), we take H,, and suppose that 
P{E,} = P, P{E,j}=Q where P+Q=1, 
P(E, | E;_,} =F, P(E; | E,_4} = Q, 
The conditional power function P{g | r,r, H,} follows in a straightforward way by considering 
the partitions of r, and r, as was done to obtain the distribution of g under Hy. For each par- 


tition within a given number of 2¢ or 2¢ + 1 groups the multiplying probabilities are the same, 
for all that matters is the number of transitions from E to E and back again. Thus for a given 








y on 


punt 
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sequence of 2¢ groups beginning with # there are 2¢—1 transitions, ¢ from E to £ and t—1 
from E to E and the remaining r,—t¢ and r,—t¢ are permanences of E and E respectively. 
The probability of obtaining a given sequence of 2¢ groups is equal to 


PP PE* Qi Os + OOO Pit PS, 


which may be written (5 - 5) (2%) P72 Qe. 


In the same way the spits of obtaining a given sequence of ¢+1 groups of £ and t 


of E is ri¢ ra) P% Q3:, and of ¢ groups of EF andt+1 of E is o(2 2) P2 Qe. 
oF, oP, 


Table 3. Values of g,, such that P{g>g, | 1,72} = a, where « is as near as possible to 0-05 
(The value of a is given in brackets) 

















rT, Or 7, eth 

2 8 13 17 
. ee " “ 
a (0- 039) — sit i 
A (0- 024 (0-055) (0-036) 
: (0 040) (0-048) (0-040) 
(0-039) (0-038) 

7 = 6 9 
(0-053) (0-034) 

8 — — 8 
(0-035) 

9 — — 7 
(0-046) 

10 — —_ 7 
(0-032) 




















The joint probability distribution of 2¢ and g is given by 


P{2t,g|r,r2H,} = yes apt +a) GS) 


23(2o ) {ge t, (Fro) role 1,t, Np rol t+1, ne 


ata) =) ae) 


m (P. t - aE 

















and similarly 


(6e+1, t,¢ Np rd t+1, »9)(39 aS) 
Ts (a2) 


P{2t+ 1,9 | 772A} = 3 O1: 
Eda) tramaagr gaara 
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The probability distribution of g is obtained by summing over all ¢ from ¢ = 1 to r,—g+1, 
that is to say 





m—9+1 ome "3 P Q) (P.Q,\' 
>» P(t, t,g) ; hus + (t+ 1,t,9)5+(6t+ 1,9) 
P{g | 1,7. H,} = = 3 (2 @,) P, a (C9) 





~—e. {%) 
PQ, ‘ ry-1 re—l¢! P Q r,-1(1 re—-1¢! P rl) re—l QO 
Eee ) aia (7 - a) ee P, Sle amr. “| 


For the power of the test we require P{g>g,|7,72.H,}, where g, is given by (5). This 
probability is obtained by summing the left-hand side of (6) from g = g, to r,, and in practice 
it is simpler to sum first with respect to g and then with respect to ¢ using the expression for 


La 
= P(t,, te, 9) given in § 2. 


4, COMPARISON OF CERTAIN POWER CURVES FOR THE CRITERIA, LENGTH 
OF LONGEST RUN AND NUMBER OF GROUPS 
Throughout the computation of the power curves it has been assumed that 
P = PP,+QP.. (7) 
This condition is arrived at by using the relation P{H,} = P{E,_, E;}+ P{£;_, E;} on the 
assumption that P{H,} = P and P{#;} = Q for all i; that is to say we are assuming that the 
probability of the event # occurring at the ith trial when nothing is known about the results 
of the preceding trials is independent of i. This in effect implies that the start of the sequence 
of observations is a randomly selected point in a longer sequence following the same law. 
The power function for either criterion is given as a function of the three parameters 
P, P, and P,, but, on application of (7), reduces to a function of two parameters. If we take 
these as P, and P,, we note that P is a constant, k, on straight lines whose equations are 
kP,+(1—k) P, = k. The power functions for the number of groups criterion, as plotted by 
David for P = 0-5, 0-6 and 0-75, are then sections of the power surface cutting the (P,, P,) 
plane in the straight lines (1), (2) and (3) shown in Fig. 1. As the alternative hypothesis under 
consideration is P,>P,, the curves have been taken as starting at the central diagonal 
P, = P, = P, that is to say we are not interested in the power for P, < P,. Fig. 1 shows con- 
tours of the power surface for the number of groups criterion when 7, = r, = 10 and the 
significance level is 0-05. The probability of establishing a difference, using this significance 
level, when P, > P, is about 0-22, 0-56 and 0-89 respectively on the three contours shown. 
Alternatively we could express the power function in terms of P and P, — P,. If, following 
Markoff (1913, p. 45), we take P, — P, = 6, then | 6| is a measure of the degree of dependence 
in the sequence, and the sign of 6 indicates the direction of dependence (+ for positive 


dependence, — for negative dependence). When é = 0, the observations are independent. 
Using (7) it follows that 


P,= P+6Q, Q,= Q(1-4), P,= P(l-é), Q = Q+6P, 
and the power function for either criterion may be expressed in terms of P and 6. The power 
curves for the two criteria when the alternative hypothesis is 6>0 are shown in Fig. 2 for 
ry =r, = 10, r, = 14, r, = 6 and P = 0-5, 0-6, 0-75.* The chance, a, of rejecting H, when it 
is true is different for the two criteria; this is inevitable owing to the discontinuity of the dis- 


* When P = 0-5 and P = 0-6 the power curves are so close as to be indistinguishable on the graphs. 


This can be seen, too, from the contours in Fig. 1, for the contours are very nearly parallel to the 
diagonal 6 = P,—P, = 0, for this range of P. 


a NPT 





(7) 
the 
the 
ts 
nce 


fe ee 





G. BATEMAN 105 


tributions. For example, when r, = 14, r, = 6, P{g>10| Hy} = 0-038 (see Table 3), while 
P{T <6| Hy} = 0-058. These are the values of a nearest to the 0-05 level in each case. But, 
allowing for this difference, it is seen on comparing similar curves for the two criteria that 7’, 
the number of groups criterion, is the more powerful in detecting departures from randomness 
of the single dependence kind. This might perhaps have been expected on intuitive grounds. 


1-0 T "¥ T T 





Pa 
e 
0-9} = 
% 
0-8F 2 
0-74 
0-6 a 4 


O-SF 4 


Scale of P, 


0-44 


0-3+ 


O-2- 














0 OF O2 03 O4 05 06 07 08 09 1-0 
Scale of P, 
The 5% significance level has been used. 


Fig. 1. Contours of the power surface for the number of groups criterion, T. (7, =7,= 10) 
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Comparison of power curves for T and g. 
Fig. 2. Case where the alternative hypothesis is.positive dependence of the simple kind: 
— P{T<T,\r7,H,} --- Pig>ge|"17 Hy} 
For curves (i) P = 0:5 or 0°6 (see footnote to § 4). For curves (ii) P = 0-75. 
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It can further be noted that for either criterion the power is greater when r, = r,, though 
the difference is more marked for the length of the longest run. In quality control work it is 
usual to consider runs above and below the median rather than above and below the mean. 
This ensures that 7, = r, and gives increased power to the test. 


5. THE DISTRIBUTION OF THE NUMBER OF GROUPS WHEN THE HYPOTHESIS 
IS THAT OF DOUBLE DEPENDENCE IN THE CHAIN 


In § 4 it has been shown that 7' is a more powerful criterion than g for detecting departures 
from randomness when the alternative hypothesis is that of single dependence. It would be 
interesting to compare the powers of the tests when the alternative hypothesis is dependence 
of a different kind. Unfortunately the formulae become increasingly complex as the number 
of parameters defining the sequence is increased. We shall, therefore, deal only with the case 
of what could be called double dependence or dependence of the second order. 
It is assumed in this case that each event is dependent only on the two events immediately 
preceding it. The general formula P{e,e,...e,} = [] Pf{e,;|e,e,...¢;,} then reduces to 
r i=1 
P{e,e,...¢,} = T] Pie; | e;2¢;_,}. This is the basis of hypothesis H,, and it is further assumed 
i=1 
under H, that 
(i) when nothing is known about the results of the (i — 2)th and (i — 1)th trials, 
P{E}=P and P{F}=Q; where P+Q=1; 
(ii) when the result of the (i — 1)th trial is known, but not the result of the (i — 2)th trial, 
PIE, |B, j=P, P{B;| £4} = A, 
(iii) when the result of the (¢ — 2)th and (i — 1)th trials are known, 
P(E; |E,2L,j=p, P{H,|£,.B}=%, 
P(E; | E;_2H;_4} = Pr» P(E, | H;_» E;_4} = Sm 
P{E;|H; 2H; }= ps, P{h;| B;»2H;_4} = qs, 
P{E,| £;.H,,} =p, P{E;| BB; .}=q,, where p;+q;=1 for j = 1,2,3,4. 


Using the relations P{E;} = P{E,_, E+ P{H,_, B3, 
P{E;_, EB} = P(E, E,_, B+ P{h,_,E,_, EB; 
and P{E,_, By} = P{E,_, HB ,_,B3+ P{h,_.H#,_, £3, 
we obtain condition (7), i.e. P= PP,+QP,, 
together with Pp, + Qips = F, (8) 
and P,p.+ QP, = Py. (9) 


These conditions again ensure that the start of the sequence is a point chosen at random in 
a longer sequence, and can be written in the form 


pione Hews. P< P, a Pa(l—Pi1+Ps) , 
l-—p,+p,;' * 1—po+ Dp,’ 1-PR+P py(l—pyt+ps)+(1—p,) (1 — pet da) 


Thus the problem is reduced to one with four parameters p,, Ps, Ps, Pa: 
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To construct the power function under H, it is necessary. to consider not only the sequences 
of 2¢ or 2¢+ 1 groups, but also the subset of such sequences containing a specified number of 
single Z’s and of single E’s. If the r, E’s are partitioned into ¢ parts of which m, parts consist 
of a single Z, then there are t—m, parts consisting of two or more Z’s, and the number of 
times that E follows EE is r, —m,—2(t—m,), i.e. r, — 2t+m,. Similar results hold if the r, E’s 
are partitioned into ¢ parts of which m, parts consist of single Z’s. Suppose this sequence of 
2t groups starts with at least two consecutive Z’s and ends with at least two consecutive E’s. 
Then it can easily be seen that the probability of obtaining such a sequence is 

PP, 9p Gee 42 59, (Pada) p3g3" 





which we may write for brevity = z, where 


PsPa 


— Pals)” I ra tees) 
2 = prigt2|—— . 
sills ef 472 PGs 
and refer to as sequence (i). The results for sequences (ii) starting HZ, ending FE, (iii) starting 


PP, , PQ, Ra 
EE, ending EE, (iv) starting EZ, ending EE are —* Poy he oa 
corresponding results are obtained when the E’s and E’s in (i), (ii), (iii) and (iv) are inter- 
changed. 

For a sequence of 2¢ + 1 groups the subdivisions are into (a) t+ 1 groups of r, Z’s containing 
m, single E’s and¢ groups of r, #’s containing m, single E’s, and (b) t groups of r, E’s containing 
m, single E’s and t+1 groups of r, #’s containing m, single Z’s. Under (a) the sequences 
considered are those (i) starting EH, ending FE, (ii) starting EE, ending FE, (iii) starting 
EE, ending FE, (iv) starting EF, ending EE; and the probabilities of obtaining these 


sequences are Phi. PRG 41z,—} PQ: Ps, PQ P Poh, respectively. Under (6) four corresponding 
Pi’ Pid Pid pi 


subdivisions are considered. 

Finally, the number of ways in which each such sequence can occur is required. The number 
of compositions of (r, —m,) E’s into (t—m,) parts when no single E£ occurs is "*"C,_,,__, for 
m,= 0,1,...,¢—1,andisunity form, = t = r,. Thisis the coefficient of 2:—™ in (2? + 23 + ...)h. 
Since the m, single H’s can occupy the ¢ spaces in ‘C,,, ways, it follows that the number of 
compositions of r, H’s into ¢ parts, m, of which are single H’s, is "*—C,_,, _,.'C,,,. If this be 
denoted by h,(t,m,), then the number of sequences of 2¢ groups containing m, single E’s 
and m, single E’s is 2h,(t,m,) h,(t,m,) and the numbers of sequences of 2¢ groups specified 
by (i), (ii), (iii), (iv) are given by the product of h,(¢, m,) h(t, mg) with 

(t—m,)(t—m,) (t—m,)m, mi(t—m,) mm, 
é? . ? : # : e 
respectively. Similar results hold in the other cases. 

Combining the results and summing for all m, and mg, we obtain 


——z respectively. Four 








P{2t |r, 7. H,} = 5 and P{2t+1]|r,r.H,} =7 for ¢=1,2,...,rg and r,>7q,- 
where 


t ¢ m ms th, (t,m,) ho(t,m iT PR QQ: 
pi P19s\"(P 24a stats) u(t, My) halt, Ma)| a yg 
"ee 2 ber =, os x) ( PIG #. L wa) C— sm) sPa oe 


PP, . QP. P PO.+0P. 
+ (t—m,)m, (2 + £4) +m,(t— mg) (C2, vat mym,(~ 2 OF ‘)] 4 
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t+1 t+1 ™m Me t 
is Pits) (E2s) (Pebetats) 
B= f3f'44142 
no ane Pade PIG 
: [zt +1, m,) hg(t, mg) P 
t(é+ 1) pr 
Saath at mM) ha(t + 1, m2) Q 
q% t(t+1) Gi 





{(¢—m+ 1) (¢—m,) .+m,(¢—m, + yy Subs 
3 





2 ((—m,+ 1) (t¢— mq) Q. + m,(t—m, + yeaa Tale 5 mlm, Dae ial 
2 2 


TT. 
C= > (A+B), and where h,(t,m,;) ="%*"C_,,1."C,, for m,;<t 
t=1 


=] for m,;=t,i=1,2. 
Using conditions (7), (8), (9) these expressions simplify to some extent, and we may note: 

(1) If p, = py = pg = Py, then P = P, = P, and P{T |r,r,H,} becomes P{T'|1r,r,H)}, for 
A reduces to 2":-1C,_,°-1C,_, and B to "—10,"-1¢,_, +7710," C;. 

(2) Ifp, = p,and p, = p,4, then P, = p, and P, = p, and P{T |r,r,H,} becomes P{T |r,r.H,}, 

P, Q, ‘ a Q r,-—1 T2—1 
for A reduces to ( PQ ( P,* Q, C,_,"* *C,_,, and B reduces to 
P, Q ‘TP 4-177 r2—1 Q r-1 r2—1 
(a) [RTaraat gaa], 

(3) If p, = p, and p, = p,, then P = P, = P, and we have what might be called ‘throw: 
back’ dependence, for the result of the ith trial depends only on the result of the (i — 2)th 
trial, and in fact the odd and even events in the sequence form independent sequences. The 
group test will be of little use unless we are interested in both positive and negative dependence 
as the alternative hypothesis. 


(4) If p, = ps, then the dependence is of the ‘global’ type, for each event depends only on 
che number of ‘successes’ in the preceding two trials. 





6. THE DISTRIBUTION OF THE LENGTH OF THE LONGEST RUN UNDER HYPOTHESIS A, 


This distribution can be obtained in a manner similar to the foregoing, but the formula is 
even more unwieldy. Weshall consider, therefore, only P{g > s|r,r,H,}. Supposeh,(t, m;g <8), 
where i = 1, 2, is the number of compositions of r; elements into ¢ parts of which m; parts 


contain one and only one element and such that no part contains s or more than s elements. 
Then 


t—m 
h,{t,m;,9 <8) = [= (- ie-miC, Ae-MI-WG) Cra, for s=3,4,...,7;+1 


ot for s= 2, 

where the expression in the square brackets is the coefficient of zt“ in the expansion of 
(a? +a5+...+28-1)-™, Clearly h(t,m,;,g<7r;+1) = h(t,m,). The number of sequences of 
2t groups containing m, single Z’s and m, single #’s and such that the longest run of either 
E’s or E’s has length greater than or equal to s is 


2[h,(t, m) helt, ms) — h(t, my, 9 <8) h(t, mg, 9 <8)], 


2 2 /t- 
ie. 2] 11 **"C_..-1C..— Il (s-¥ tmdyt-6-813G, 4. 11m) |. 


i=1 
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If we denote by A’ the expression obtained on replacing h,(t,m,)h,(t,m,) in A (see §5) by 
h,(t, m,) ha(t, my) — h(t, m,, 9g < 8) ho(t, mz, 9 <8), and if we obtain B’ from B in a similar way, 
then m4—s+1 
y (A’+B’) 
P{g>s\|r,r,H,} = — 
2 (A+B) 


7. COMPARISON OF CERTAIN POWER CURVES FOR THE CRITERIA 7' AND g 
WHEN THE ALTERNATIVE HYPOTHESIS IS DOUBLE DEPENDENCE 


In plotting the power curves, only the cases where 


Pit Py = 1= pet Ps (10) 

have been considered. Using the relations previously obtained, namely 
P3 Pa P, 

~ 1=py+Ps’ “ke 1—pot+ py the. 1-P, +P,’ 
it follows from (10) that P, = Q., P, = Q, and P = 0-5. This seems a reasonable case to take 
for it merely implies symmetry with respect to E and Z. Writing the relations out in full we 
have P = 0-5, P, = Qo, Py = Q1, Pa = Up Pi = Ua» Po = Yq ANd Ps = J. The power functions 
can now be expressed in terms of two parameters, say p, and p,. Three sections of this power 
surface have been considered for r, = r, = 10, namely sections by the planes (a) p, = p, 
(H, in Fig. 2), (6) p, = 0-5 (Hq in Fig. 3), (c) 4p,— 2p, = 1 (Hg in Fig. 3). 


P, 


r;=r2=10, alternative hypothesis Hj (p:=0-5) ri=r2=10, alternative hypothesis HY( ip;—2p,=1) 


1-0 T 1-0 


f Ae. 
0-9 0-9 ae 
V fu 








7 


















































0-8 08 * 

/ we 

0:7 | 9.74 ke 
7 * 7) 
7 06 ) 7 = 0-6 {-—+ 

: | i 

~ 05 , 5 0.5 ae 
: F : Py 
= 0.4 = } 














0-2 0-2 af 1 















































i> 
Ys “ | 
or 4 or 44 
ce VA | 
0 0 oe 
0:5 0-6 0-7 0-8 0-9 1:0 05 06 07 0-8 09 1-0 
Scale of p, Scale of p, 


Fig. 3. Case where the alternative hypothesis is double dependence: 
— P{T<T,\r,7,H,} --- Pig>gq:|"172H3} 


(a) When p, = pz, as it does along the central diagonal in the ( p,, ps) plane, the dependence 
in the sequence is of the single kind, and when p, = p, = 0-5 then there is independence. 

(6) When p, = 0-5, then the dependence is of the global kind for the probability of obtaining 
a success at any trial depends on whether there were 2, 1, 0 successes in the preceding two 
trials; and in the case taken these probabilities decrease in arithmetic progression, e.g. when 
P, = 0°7, po = Pg = 0-5, py = 0°3. 
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(c) When 4p, — 2p, = 1, the dependence is intermediate between these two types. Typical 
values of p,, 2, P3, P, are Shown in the following table: 





Pr 0-5 0-6 0-7 0-8 0-9 
Ps 0-5 0-55 0-6 0-65 0-7 
Ds 0-5 0-45 0-4 0-35 0-3 
Pa 0-5 0-4 0-3 0-2 0-1 


























It will be seen that, apart from the first column in which the events are independent, the 
probability of an event E occurring decreases according as the results of the two preceding 
trials are EE, FE, EE or EE. 

When the alternative hypothesis is single dependence, then, as we have noted previously, 
the g criterion is considerably less powerful than the 7’ criterion in detecting departures from 
randomness. This point is illustrated by the power curves of Fig. 2. The power curves of 
Fig. 3 show that this is not necessarily the case when the alternative hypothesis is double 
dependence, for in one of the two cases considered the g criterion would appear to be no less 
powerful than 7' in detecting departures from the basic hypothesis. 

It is realized that this investigation is not yet complete, but further work is being done 
on types of dependence likely to occur in practice, and on the possibility of using an estimate 
of the degree of dependence in a sequence as a test criterion. 


8. ILLUSTRATION OF DEPENDENCE IN A SEQUENCE 


As an illustration of sequences which might show dependence, two passages have been taken 
at random, the first from a standard text-book on Statistics and the second from Gertrude 
Stein’s writings. The event, F, recorded is the occurrence of a word of one syllable, while £ 
is the occurrence of a word of more than one syllable. To eliminate possible end effects the 





























First sample Second sample 
Present word Present word 
E E Total E E Total 
z z 
° a aes 
5 5 
we) # 194 | 133 | 327 we] £ 301 s9 | 390 
4| 2 132 41 | 173 S| 2 89 21 | 110 
o 
3 ae 8 | | 
a } | 
Total | 326 | 174 | 500 | * | Total | 390 | 110 | 500 
| | 














Present word Present word 
























Preceding two words 
Preceding two words 






































































ical 


the 
ling 


sly, 
rom 
s of 
ible 
less 


lone 
1ate 


ken 
ude 
le E 
the 





G. BATEMAN lll 


first three and the last three words in each sentence have not been counted. The results for 
the individual sentences have been pooled to obtain the above frequency tables. The total 
number of words counted was 500 in each case. 


Estimates of the probabilities, relative probabilities and degree of dependence (6) are 
shown in the following table: 








A A A A 

P P, P, Py Pe Ds Pe é 
ist sample 0-65 0-59 0-76 0-56 0-76 0-64 0-78 —0-17 
2nd sample 0-78 0-77 0-81 0-76 0-78 0-80 0-91 — 0-04 



































If we take as our hypothesis that P, = P, = P, then, applying the x?-test for independence 
to the 2 x 2 tables above, we obtain values for y* of 13-62 for the first sample and 0-49 for the 
second sample. On this evidence we reject the hypothesis of independence in the first case, 
but not in the second case. The first sample does, in fact, seem to exhibit a degree of negative 
dependence of the single kind, i.e. given a monosyllabic (or polysyllabic) word the chance of 
its being followed by another monosyllabic (or polysyllabic) word is less than it would be 
if the events were independent. It is not clear whether or not the sequence shows double 
dependence. Applying the y*-test to the 2 x 4 table we again get a significant value for x’, 
which leads us to reject the hypothesis, p, = p, = p; = p, = P; but it might still be the case 
that p, = ps = P, and p, = p, = B,, when the double dependence would reduce to single 
dependence. 

in the second sample it might well be that P = P, = P, = p, = pz = ps = Py, the fluctua- 
tions in the estimates being due to chance, and the x?-test applied to the 2 x 2 and to the 2 x 4 
table confirms this. Thus in Gertrude Stein’s work monosyllabic and polysyllabic words 
would seem to occur at random. 


9. APPLICATION OF THE DISTRIBUTION OF THE LONGEST RUN 
TO THE CLASSICAL PROBLEM OF ‘RUNS OF LUCK’ 
The problem of ‘runs of luck’ was first put forward and solved by de Moivre. It is concerned 
with finding the probability that an event Z occurs at least s times in succession in-a series 
of r independent trials, when the probability that the event EZ occurs is constant and equal 
to p. The problem has been solved using difference equations. The alternative solution given 
below is based on the distribution of the longest run. 
It has been shown in § 2 that, if g, is the length of the longest run of E’s, then 


(r,/8] 
P{9g>8|ry723} = DY (— HCCC, where +r, =r. 

j=1 

If r (the number of independent trials) is given and P{Z} is constant and equal to p, then 
P{ry} = °C,, pg” 
Tr 
and P(e >8} = X P{gg>s\|1,}x Pfr;} 
1=8 


dl 
2, 2 ( i igs — r*C,, | ig” 
T+ 1 


x ( i yn r-i8C;,_, p'*qi —1 =, ; r-HEtDHIC) _ 5 prrtegrs-i+1, 
nr, >is 
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n 
Using the relation >} "C, p*q"-* = 1, we obtain 
k=0 


P{gz>8} = = E (—yec,_ pig'a(14—2 rest) 


j>1 “ 


{r/s) 
> (= (p+ At =e *q) #6, pig, 


This can readily be shown to be identical with the solution using difference equations, as 
given by Uspensky (1937, p. 77). 


I wish to thank Dr F. N. David for suggesting the subject and for advice given in the 
preparation of this paper. 
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SUR LES COURBES DE FREQUENCE DE K. PEARSON 
Par M. DUMAS, Ingénieur en chef de l Artillerie navale (Marine nationale francaise) 


1. K. Pearson a indiqué (1895, 1916) comment il était possible, connaissant les rapports 
homogénes £, et £, d’une distribution, de calculer l’équation de la courbe des densités d’une 
loi de probabilité ajustant cette distrib::tion. Il a di considérer différents cas, suivant la 
région du plan des £,/, dans laquelle se situe le point intéressant. Ces régions sont indiquées 
avec précision dans une figure* (K. Pearson, 1916), reproduite en téte de la Part IT des 
Tables for Statisticians and Biometricians (K. Pearson, 1931). 

Nous nous proposons dans le présent mémoire d’attirer l’attention sur ce qu’il est utile 
de compléter les indications de la figure susvisée en tragant une nouvelle courbe. Pour 
lexposé correspondant, nous conservons les notations utilisées aux p. lx et suivantes de la 
Part I, édition de 1930, ot se trouve un tableau des équations des courbes des fonctions y(x) 


de K. Pearson. Nous rappelons que l’équation différentielle servant de point de départ & la 
théorie est ldy aa 


ydt Cott, x+C,2" 
2. Celles des lignes tracées sur la figure susvisée qui sont les plus intéressantes 4 considérer 
du point de vue des formes des courbes représentatives des fonctions y(z) sont: 


(a) la droite: 28,—38,—6 = 0; (1) 
(b) la cubique et la biquadratique ayant respectivement pour équations: 

8, (B+ 3)? — 4(482— 3f,) (28,—3f, — 6) = 0, (2) 

B,(B2+ 3)? (88, — 9B, — 12)— 4(48,— 38) (58,— 68, — 9)? = 0. (3) 


La biquadratique définie par (3) peut étre dite biquadratique de discontinuité des ordonnées, 
car on peut établir ce qui suit: si l’on considére les courbes des fonctions y(x) correspondant 
respectivement aux /, et £, de deux points voisins de la biquadratique (3) mais situés de 


part et d’autre de celle-ci, l’une de ces courbes a une ordonnée nulle en un point ayant pour 
abscisse une solution de l’équation: 


Cot, X+c,x? = 0, (4) 


tandis que l’autre courbe a, au point correspondant au précédent, une ordonnée infiniment 


grande. 


C’est ainsi par exemple, que la traversée de la branche marquée VIII sur la figure de la 
Part IT susvisée, fait passer la courbe y(x) du type I, au type J (comme cela est rappelé sur 
les figures 2 et 4 ci-jointes), en passant d’ailleurs par le type VIII (Fig. 3). 

Tl est commode, notamment pour la construction des courbes, de remplacer les équations 
(2) et (3) par des équations paramétriques, en prenant pour paramétres /, et le coefficient 
c, de la quadratique (4). On établit en effet que les équations susvisées sont équivalentes 


a la relation 2(1 + 5¢e,) B, = 3(1+ 4cy) By + 6(1 + 3c,), (5) 


* Cette figure présente notamment l’avantage d’indiquer comme limite de la partie utile du plan 
des £, 8, la droite £,— ,—1 = 0, et d’exclure par suite la droite 4f,—3f, = 0, indiquée dans la figure 
xxxvi de la Part I des mémes ‘Tables’. 
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complétée en ce qui concerne la cubique (2) par 
_ _ 16e,(1+ 3c) | 6 
A=—~Gray ° ™ 
et en ce qui concerne la biquadratique (3) par 
_ ___ 4(1 + 3¢9) - 
Au = GT yaeyP(l +e)" . (7) 


3. L’axe des f,, la droite £,—£,—1 = 0, la droite (1), et les courbes (2) et (3) limitent 
différentes régions du plan des /,/,; ce sont les seules régions considérées par K. Pearson 
pour définir ses types de courbes; pour chacune de ces régions, une seule et méme expression 
y(x) est valable. Mais il se trouve que dans certaines de ces régions ]’équation correspond a 
des formes & courbes nettement différentes les unes des autres, car aux points ot y = 0, la 


pente de la tangente a la courbe y(x) peut étre soit nulle, soit infiniment grande, soit encore, 
comme état intermédiaire, finie non nulle. 


Nous avangons que tous les points pour lesquels ces pentes sont finies non nulles, sont 
ceux situés sur la courbe d’équation 


B(B,+ 3)? (58 — 6B, — 9) — (48 2—38,) (78, — 98, — 15)? = 0. (8) 
Soit 4 démontrer cette proposition. 
Rappelons d’abord que la théorie de K. Pearson donne pour les coefficients de la quad- 
ratique (4) les expressions 
Co = —Ha(1+3eq) et c, =—he(1 +45) V(u2/3) (9) 


(ce = +1 ayant le signe de ,,), auxquelles s’ajoute l’équation (5) donnant c, en fonction de 
B, et de f,. 


Puis, appelant x, et x,, avec 2, < 22, les solutions réelles de l’équation (4), c’est & dire 


: _ ~GrtV(Ci— 499) 








10 
X, 2c. ( ) 
Cy— 2% L_g—Cy 
sons m, = ——— et m, = ——;; (11) 
vig + Cs(2%3—}) 3 q(%_4—2,) 
. m 1 (1 + 2c.) (1+ 4c,) /f. 
d’aprés (9) et (10 = as 2 2) VP1 2 
sean Me) 2a -2Wy/[P,(1 + 4cy)* + 16c_(1 + 3c4)] (12) 


Considérons maintenant le cas particulier ot la solution y(x) a pour expression 
y(x) = k(a—2,)™ (w—2)™,; 
c’est le cas oll, pour ,>0, la courbe représentative est du type VI de K. Pearson. Dans 


ce cas dy(x) k ae ac 
i “a eee 1? (w—2_)™—", 








Manifestement, on ne peut avoir a la fois y(x) nul et we) fini non nul que pour 2 = 2, 


(ou x = 2,), 4 condition d’avoir en méme temps m, = 1 (ou m, = 1), c’est 4 dire, d’aprés (12), 
ci ee 

2ey) ~ 4e¥[B,(1 + 4cq)*+ 16c4(1 + 3c,)) 
Si dans cette expression on porte la valeur de c, déduite de (5), on trouve (8). 


Nous ne croyons pas utile d’indiquer ici la discussion compléte, seule capable de montrer 
que la courbe d’équation (8) est valable dans tous les cas et qu’elle est la seule valable. 
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4. L’équation (8) est l’équation d’une nouvelle biquadratique qui peut étre dite, pour la 
distinguer de celle qui a pour équation (3), biguadratique de discontinuité des dérivées en 
raison de la propriété qui a conduit & la considérer. Ses équations paramétriques sont 








léquation (5) complétée par 2(1 + 3c,) (1 — 2c,)? 
1 (1+ 44)? 
2 “ 2 5 
oF T { T T T T T T T T T : 





Points spéciaux: 


ob A ps 
xe ‘te 
M0 15/7 
NO. 3 
10F L032 24 
D2 6 
E4 9 
11+ FF’ voir les figs. 2-12 











1 i i wil aI i = ' i» i 4 a 


Fig. 1. Limites de régions du plan des /, fy. 





La partie utile de cette biquadratique a deux branches dont l’allure générale est celle des 
deu:: branches de la biquadratique (3); l’une d’elles est asymptote a la droite d’équation: 


5f,— 62, —9 = 0; 
lautre est pour f, infiniment grand, asymptote & 
B, = 39-2; 
cette derniére équation est & comparer aux suivantes 
£, = 32, qui est celle de l’asymptote & la cubique (2); 
£, = 50, qui est celle d’une asymptote & la biquadratique (3). 
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Fig. 2 Fig. 3 Fig. 4 Fig. S 
Comme fig. 4 
p,mss f= 2421228 6-112, imermétiaire B,=66 
(Point de la biquadratique de 
Type de di inuité des ordonnées) : 
K. Pearson®; ly Vul 1 t xl 
Fig. 6 Fig. 7 Fig. 8 Fig. 9 
Comme fig. 4 | | 
A; intermédiaire f.6-72 A; intermediaire A=? 
(Point de la biquadratique de (Point £) 
Type de discontinuité des derivées) 
K. Pearson*. ly ly ly x 
Fig. 10 Fig. 11 Fig. 12 
; intermédiaire f2210-2 A.@12 
(Point de la biquadratique de 
Type de discontinuité des dénvees) 
K. Pearson® Vi vi ‘Vi 











Figs. 2-12. Formes des courbes y(x) pour f,=4 (c’est & dire le long de la section FF’ de la figure 1). 
* D’aprés la figure de K. Pearson (1931) visée au § 1 du présent mémoire. 


t+ Nous avons marqué I; bien que, sur la figure visée en la note précédente, aucun type ne soit 
indiqué dans le, région correspondante. 














Fig. 13 Fig. 14 Fig. 15 
Points: de A & D (inclu.) de Da M (exclus.) Wy 
(pour D: 8 =2, B.=6) (P=0, £:=15/7, courbe 
symétrique) 
Fig. 16 Fig. 17 Fig. 18 


co Hi 


Points: de M 4 L (exclus.) L de L (exclus.)& B 
(Pi=0°32, £=2-4) 





Figs. 13-18. Formes des courbes y(z) pour les points de la biquadratique de discontinuité des dérivées. 
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Comme on le voit sur la figure 1, ces deux branches se raccordent tangentiellement & 
axe des £, au point M B,=0, B,=48; 
l'une d’elles coupe la biquadratique de discontinuité des ordonnées au point 

B, = 0-32, f= 2-4, 

gui est le point Z de K. Pearson, tandis que l’autre branche coupe la droite d’équation (1) 
au point D B, = 2, B. = 6. 

5. Pour donner une idée de l’intérét de la considération de la biquadratique de discon- 
tinuité des dérivées, nous avons établi les figures 2 & 18 ci-jointes. Les figures 2 & 12 indi- 
quent la succession des formes des courbes y(x) que l’on rencontre dans le cas ou, f, restant 


constamment égal 4 4, 8, croit depuis les environs de 5-5 jusqu’é ceux de 12; en raison de ces 
valeurs, le point représentatif reste touj:-urs compris entre le droite limite d’équation 


b,—f,-1=0, 
et la cubique d’équation (2), et passe par le point 
Ay = 4, Be = 9, 


qui est le point #, point exponentiel, de K. Pearson. 

On remarquera qu’au type J, de K. Pearson (Figs. 6, 7 et 8) correspondent trois courbes 
d’allures nettement différentes l’une de l’autre, et qu’il en est de méme pour le type VI, 
(Figs. 10, 11 et 12.) 

Les figures 13 & 18 indiquent la succession des formes de courbes y(x) que l’on rencontre 
dans le cas ov le point £,, £, suit la biquadratique de discontinuité des dérivées depuis A 
(Fig. 1) jusqu’é B en passant par M. 

Nous comptons publier prochainement un exposé complet de la théorie mathématique 
conduisant aux fonctions y(x); & cet exposé seront joints un tableau d’environ 34 figures 
donnant les allures des courbes y(z) pour tous les points possibles du plan des £, f, avec, en 
particulier, les figures 2 4 18, et toutes précisions analytiques sur les fonctions y(x), notam- 


ment sur celles qui correspondent aux points de la biquadratique de discontinuité des dérivées 
(Figs. 13 & 18). 
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THE DISTRIBUTION OF THE EXTREME DEVIATE FROM THE 
SAMPLE MEAN AND ITS STUDENTIZED FORM* 


By K. R. NAIR 


1. INTRODUCTION 


Denote by 2 ... x.) a random sample of n observations drawn from any statistical universe. 
Let x,, ...,2, be the same sample arranged in ascending order of magnitude so that x, is the 
rth ranked (or ordered) variate in the sample {x}. 


Various authors have studied the sampling distribution of z,. It takes a simple form when 


r = lorn. Thus, if f(x) is the probability function of the universe from which 7's are drawn, 
the probability that x, < X is given by 


mxy=|[* peas]. (1) 


If the parent universe is normal with mean y and standard deviation 


ee . 
fle) = eg exp| — “54 |. (2) 


The probability that xz, < X is the same as that of 





L,—h X-— , 
vy, =< —f=V ( 





and may be written P(X) = P(V) = (sas) eas)”. (4) 


Tippett (1925) tabulated values of P(V) for n ranging between 3 and 1000. E. 8. Pearson 
supplemented this by a table of percentage points of V, published as Table X XI bis in 
Tables for Statisticians and Biometricians, Part II, to facilitate tests of significance of a 
single outlying observation 2, or x,, when both ~ and o are known. 

Very often we do not know either yw or o or both. When » alone is unknown, Irwin (1925) 
suggested a test for a single outlier x, based on the statistic (x,,—2,_,)/o. If there are k 
large outliers, his test would involve (x,,_,.,,—2,_,)/o and, for k small outliers, the statistic 
(41 —Xy)/O. 

Another statistic commonly used to test a single outlier, when is unknown, is one based 
on the range, viz. (x,,—2,)/o0 (see ‘Student’, 1927). 

Intuitively, one feels that a better criterion than (x, —2,,_,)/o or (x, —2,)/o when there is 
only one outlier z,, will be the extreme deviate (x, — %)/o proposed by McKay (1935). The range 
(x,, — %,) will certainly be a surer guide than (x, —~2,,_,) or (x, —%) if both x, and z, are outliers. 

In general, if there are k outliers at the lower end and / outliers at the upper end, a suitable 
criterion will be that based on the difference of the means of the first k and the last / outliers. 
When the outliers are all at one end, say the first k, we should write k + 1 = n. The distribution 
of this general statistic and some of its special cases are considered in § 5. 


* Part of a thesis approved for the degree of Ph.D. of the University of London. 
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All these test criteria should be handled with extreme caution in practice. It may be 
appropriate here to quote Pearson & Chandrasekar’s (1936) warning: 

To base the choice of the test of a statistical hypothesis upon an inspection of the observations is 
a dangerous practice; a study of the configuration of a sample is almost certain to reveal some feature, 


or features, which are exceptional if the hypothesis is true... . By choosing the feature most unfavourable 


to the hypothesis out of a very large number of features examined, it will usually be possible to find 
some reason for rejecting the hypothesis. 


Let us now consider the case where both and o are unknown. Their sample estimates are 


n n 
z= Eley and s= [|Z ~@-z%n-)]. 5) 
i 1 
If x, is to be tested as an outlier, the obvious course is to consider the modified 
McKay criterion (x, — Z)/s. The sampling distribution of this test criterion is not known, but 
Thompson (1935) suggested an alternative method based on the sampling distribution of 
T@ = (Go—)/8, (6) 
where (see above) 2; is a random member of the sample. He showed that the distribution 
of 7 can be derived from that of ¢ (with (nm — 2) degrees of freedom) using the relation 
(n—1)t . 
= 4 7 
“ \[né? + n(n —2)] @) 
On a critical examination of Thompson’s criterion Pearson & Chandrasekar found that 
it is effective only when there is essentially one outlier and not many as Thompson seemed 
to believe. 
Suppose now that « is known and ¢ is unknown. Thompson’s criterion could be extended 
to this situation if we calculate to = (tH) /8"s (8) 


where s’ = | [3 (x;—)?/n |. The distribution of 7’ can be obtained from that of ¢ (with 
1 


(x — 1) degrees of freedom) using the relation 
: t,/n 
T= V(@+n—1)° (9) 

We now come to the main theme of this paper which is to consider a method of studentiza- 
tion different from Thompson’s. If an estimate s, of the unknown @ is available with 1 
degrees of freedom independent of the sample {2,)}, a test for a single outlier can be made. 
using (x, —)/s, if 7 is unknown, and using (x,, — /)/s, if 7 is known. The distributions of these 
studentized test criteria can be derived by Hartley’s (1944) method. 

To test whether there are two outliers, one at each end, the studentized range (x, —2,)/s, 
will be a suitable criterion. Pearson & Hartley (1943) have prepared the necessary tables 
for this test. 

In this paper attention is mainly concentrated on the McKay statistic, uw = (x, —Z)/o 
(or (Y—2,)/o) and its studentized form (x,,—%)/s, (or (€—2,)/s,). It is shown that the dis- 
tribution of w can be obtained by a more direct method than was employed by McKay and 
that it can be reduced to certain integrals which have recently been termed G-functions 
by Godwin (1945) in his representation of the distribution of the mean deviation. Tables of 
the probability integral of u and of its studentized form have been prepared. 

Apart from serving as a criterion for rejection of an outlying observation in a ‘normal’ 
sample when « and o are unknown, the studentizéd form of u has useful application in judging 
the significance of a single outstanding treatment (best or worst) in a group of treatments 
tried out in a designed experiment. Some illustrations are given in the paper. 
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2. DIsTRIBUTION OF THE EXTREME DEVIATE 


Assuming, without loss of generality, that ~ = 0 and o = 1 in the normal probability 
function (2), the joint distribution w the ordered variates 2, ...,Z,, is 


l n n 
e —-=>23 dx;. 10 
Game? |- 2} | Mh 
Making an orthogonal transformation of 2,, ...,2,, into y,, ...,y, defined by 


Y= Tae eiy) ite et ta} (t= 1, ...,(%—1)) 














Zs 
“a i 11 
Tasty si 
1? a 
Yn = Jn (x;) = (nz, 
follows tl Sao Sy= Sane (12) 
it t gm } as 
it follows tha x Lyi x G4+)t nz, 
I dz, = [1d . et é (13) 
= ay; = Lae zy. 
1 : (1)! 
The joint distribution of Z, z,, ..., %,_ is therefore 
n nz2 1-1) z (n—1) 
A aki de By. Auk z s 14 
eRe | a = Frey dz IT dz;. (14) 
Integrating out for Z from —0o to +00, the joint distribution 2 Zyy +++) Mm—1) 18 
/n 1s 1) 2 (n— ld 15 
emp OP| 3 % +1 Whe 
It will be noticed that %n—1) = W(X, —Z) = nu. (16) 


To derive the distribution of z,,_,) or of wu, we have to integrate out for z,, ..., %,—g in (15). 
The ranges of the z; are from 0 to +00 but they are interlinked by the inequalities 


0<%4<... SA%n- ®) S%n- p= MU. (17) 
At this stage we bring in the G-functions defined by Godwin as follows: 
x #2 
G(x) = 1, G(x) -{ exp| - mana | G, _3(8) dt. (18) 
Integrating out z,,...,2,_, from (15) between the limits (17), the distribution of uw can 
be written In aii 
| D omnpe > <0 EE 19 
ful) = Ta sexp[ je | G,_s(nu), (19) 
and the probability integral of u is 
a 20 
(w) =|" fr(u)d ~ [J(2m)4 27) yr- —1 G,- 1(nu). ( ) 
Proceeding by an entirely different method, McKay derived an expression for P,(u) in 
the form p 1 @ ae a n a 
mt) = exp | - seam (san) _.* 2) 9 ( ) 


and obtained a recurrence formula 


f,(u) = Pi,(u) = Ten °?| - ae = mi Nicess P_ a(24). (22) 





ility 


(10) 


(11) 


(12) 


(13) 


(14) 


(15) 


(16) 
(15). 


(17) 
(18) 
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(19) 
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The integral-power appearing on the right-hand side of (21) is the probability integral of 
(x, —#)/o given in (4), revealing an interesting connexion between the probability integrals 
of (x, —%)/o and (x, —)/o. 

McKay did not attempt to tabulate values of P,(u), but for getting the upper 5 or 1 % level 
of u, that is, when P,(u) = 0-95 or 0-99, suggested the approximation 

n 

V (27) J uviniin—11 

With the help of exact values of P,(w) tabulated in the next section, it has been possible 
to examine the closeness of this approximation. The agreement is remarkably good. 

He also gave an approximate formula when uw is very small, viz. 


P(u)~1 et dt. (23) 


n-1 
P,(u)~ ; ni (ses) (n> 2). (24) 


This does not give a good agreement with the exact values. 
A better approximation was found to be 


Jn nu \"— 
Pe~ Gt (Fam) «>? (25) 
which could further be improved to 
Jn nu \""{, n(n—1)u* 
wegen) UI") >?) ig 


A comparison of these three approximations with the exact values has been made for a 
few small values of u and with different values of n in Table 4. 


From (25) and (26) we can derive the following approximation for G(x) when z is small: 


G(x) ~ = ; (27) 


x rx 
eA | see TET) 7 


3. TABLES OF THE PROBABILITY INTEGRAL OF THE EXTREME DEVIATE 


The starting-point wes manuscript tables of the G,-functions (r = 2,...,8) prepared by 
Godwin (1945) and Hartley (1945) in the course of their work on the mean deviation. 
The functions they had actually tabulated were multiples of the @-functions, namely, 
G¥(x) = 6, G(x). Keeping n = r+ 1, the probability integral of u given in (20) may be written 

P.4a(u) = ¢, GF[(r+ 1) a]. (29) 
Values of b, and c, are given below. 








r b, Cc, 

2 480 m7-1!2-1 25515518 x 10-8 
3 48027-? 2-1 61380797 x 10-8 
4 480°7-2 2-2 14297045 x 10-*5 
5 480‘7-! 2-3 65256785 x 10-38 
6 480573 2-8 . 29368910 x 10-2° 
7 480%7-i 2-® 13081952 x 10-22 
8 480’2-4 2-# 57814607 x 10-%5 
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The task was therefore to convert the G*-tables from regular arguments in x to regular 
arguments in wu. In order to avoid excessive interpolation for z = (r + 1) u in the G¥-tables it 
was decided-to adopt a pivotal interval of 0-05 for u, which required selecting for x the pivotal 
intervals 0-15, 0-20, 0-25, 0-30, 0-35, 0-40 and 0-45 for r = 2,3,...,8 respectively. The 
x-interval in Godwin & Hartley’s tables was 0-05 for r = 2,3, 4; and 0-10 for r = 5, 6,7, 8. 
At the intervals 0-35 and 0-45 for z in G, and G,, the half-way point formula of Lagrangian 
interpolation was applied on the 0-1 interval values of G3(x) and G(x). Values of P,(u) for 
n = 3 to 9 were then obtained at intervals of 0-05 and then subtabulated on the National 
Accounting Machine at intervals of 0-01. These values correct to six decimal places are given 
in Table 1 at the end of the paper. All the calculations were undertaken by the National 
Physical Laboratory, Mathematical Division, under the direction of Dr Goodwin and 
Mr Vickers. 

Table 2, printed after Table 1 at the end of the paper, gives percentage points of the 
extreme deviate, at twelve different levels. These were calculated by interpolation from 
Table 1. 

We are now in a position to examine the adequacy of the approximations (23)-(26). 
Taking (23) first, the following Table 3 shows the exact and approximate values of the 
upper 5 and 1 % points. 


Table 3. Comparison of exact and approximate upper percentage points of u 



































5% 1% 
n 
Exact Approx. (23) Exact Approx. (23) 

3 1-7375 1-7376 2-2152 2-2152 
4 1-9409 1-9413 2-4310 2-4310 
5 2-0801 2-0807 2-5743 2-5743 
6 2-1843 2-1854 2-6794 2-6795 
7 2-2667 2-2683 2-7613 2-7615 
8 2-3344 2-3364 2-8279 2-8281 
9 2-3916 2-3940 2-8837 2-8839 








The agreement is very good. This high accuracy of his formula was apparently not known 
to McKay and has now been established by computation of the exact results. It may enable 
us to extend the range of the present Table 2 for obtaining upper percentage points of u for 
sample sizes beyond 9. 

Approximations (24), (25) and (26) were compared with the exact value of P,(u) for 
u = 0-05, 0-10 and 0-20 and » = 3,4,5. The results are given in Table 4 where (a), (b), (c) 
stand for the approximations (24), (25), (26) respectively and (d) stands for the exact value. 
(a) and (6) are identical when n = 3, but it will be seen that when n exceeds 3, (6) gives much 
closer agreement than (a). 

With the help of the approximations (23) and (26) it may also be possible to extend Godwin 
& Hartley’s tables of upper and lower percentage points of the mean deviation for sample 
size beyond 10. 


To illustrate the use of Table 1 or 2 in testing the significance of an outlying observation 
an example is given below. 
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Example. This is taken from McKay’s paper. In the course of routine testing of a standard 
leather product of a tannery, five parallel tests yielded the following values for the hide 
substance content of the leather specimens: 

32-44, 36-45, 39-64, 40-13, 41-09. 
The first observation appears unduly low. 

Long experience of the product in question has established a value of 2-2 for the standard 
deviation o. We get u = (37-95 —32-44)/2-2 = 2-50. 

Value of P; (2-50) found from Table 1 is 0-987 031. The probability of getting a value 2-50 
or larger for u is thus about 0-013. If we use Table 2 only, we see that this probability is 


between 0-025 and 0-01. On the 5 % level of significance, we conclude that the observation 
32-44 is anomalous. 


Table 4. Comparison of approximate and exact values of P,(u) when u is small 



































n Method u = 0-05 u= 0-10 u = 0-20 
3 (a) 0-003 101 0-012 405 0-049 620 
(b) 0-003 101 0-012 405 0-049 620 
(c) 0-003 095 0-012 312 0-048 131 
(d) 0-003 095 0-012 312 0-048 166 
4 (a) 0-000 127 0-001 016 0-008 127 
(b) 0-000 169 0-001 355 0-010 836 
(c) 0-000 169 0-001 338 0-010 316 
(d) 0-000 169 0-001 338 0-010 334 
5 (a) 0-000 004 0-000 071 0-001 133 
(d) 0-000 009 0-000 148 0-002 360 
(c) 0-000 009 0-000 145 0-002 202 
(d) 9-000 009 0-000 145 0-002 210 








(a) McKay’s approximation (24). 


(c) New approximation (26). 
(b) New approximation (25). 


(d) Exact value. 


4. THE STUDENTIZED INTEGRAL OF THE EXTREME DEVIATE 


We have seen that in order to apply the test for the extreme deviate x, —%, it is necessary 
to know the standard deviation o of the parent normal population. We shall now assume that 
an estimate s, of the unknown c, equal to the square-root of a variance based on v degrees 
of freedom and independent of the sample (x, ...,x,) is available. 





Let ,P,(Q) denote the probability that u, = aa" < Q. When v->co this tends to the 


~F v 
Ly, —% 


probability P,(Q) that w = - = < Q given by (20). 





Using Hartley’s expansion for studentized integrals up to terms in y-* we may write 


yPr(Q) = 9+ 4,/v + a,/r*, (30) 
where a, = P,(Q), 
and a, = Q*P*(Q)— QP.(Q)}. (31) 


Ay = g6(3Q*PT(Q)— 2Q°P2(Q)} — dar. (32) 








124 Distribution of the extreme deviate from the sample mean 


Godwin & Hartley had prepared manuscript tables of G¥’(x), the first derivative of G¥(x). 
Values of P;,,(Q) could be calculated with the help of these tables, using the formula 


Prax(Q) = Te (r+ 1), GP"), (33) 


where x = (r+1)Q = nQ and W is the interval of z in G¥'(z). 

Tables of P}(Q) for n = 3,...,9 were prepared at the pivotal interval 0-05 for Q just in 
the same way as P,(u) was calculated from G(x). 

Values of the 2nd, 3rd and 4th derivatives of P,(Q) were obtained from P’,(Q) by numerical 
differentiation on the National Accounting Machine. Substituting these in (31) and (32), 
values of a, and a, were obtained at a pivotal interval of 0-05. Table 5, printed at the end of the 
paper, gives the values of ay, a, and a, at 0-20 interval for the argument Q. Values of ,P,(Q) 
can easily be read off from this table using formula (30). For sake of convenience in making 
tests of significance, 5 and 1 % points have been calculated in Table 6, which is also repro- 
duced at the end of the paper. 

Since numerical! differentiation had to be used in calculating even a, and a,, it was not 
feasible to bring in the next higher terms a,v~* and a,v~ for calculating ,P,(Q) as that would 
have involved calculation of the 5th to 8th derivatives of P,(Q) by numerical differentiation. 

Values of a, are given in Table 5 to four decimals for all values of n except n = 3, for which 
five decimals have been supplied. The maximum error is not more than 2 in the last place. 

Values of a, are given to three decimals for all values of n except n = 9, for which only two 
decimals are retained, when Q exceeds 1-00. The maximum error is not more than 4 in the 
last place. 

This degree of error is inherent in the method of numerical differentiation which was used, 
but will not seriously affect values of ,P,(Q) when v is moderately large. It is essential, 
however, to check against systematic errors and for this purpose the following checks 
proved quite useful: 

(i) When x = 3, it is comparatively easy to calculate the exact values of a, and a, directly 
from the expressions 


a, = ay8 Q|3Qe-s0* — (3Q? + 2) tof era : 


87 0 





a, = X= @*{3Q(1809"— 16) ¢-20"— (279*— 429% 8) e-40"[ 


2°" 2567 e 
In the table below a small panel of values has been calculated from the above exact 
formulae and compared with the values given in Table 5. The agreement is very satisfactory. 


e# at —ia). 











Table 7 
a, a 
Q 
Exact Approximate Exact Approximate 

1 — 0-38720 — 038720 + 0-275 + 0-275 
2 — 0-25540 — 0-25540 — 0-550 0-551 
3 — 0-01866 — 0-01865 — 0-324 — 0-323 
4 — 0-00022 — 0-00021 —0-014 
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(ii) It is easy to see by partial integration that the expected value of (x, —Z)/o or (¥—2,)/o 
can be expressed in t.rms of integrals of a, and a, over Q from 0 to oo. Thus, 





Cc 


E (==) - [-oPacqnae 


where P},(Q) is given by (33). 


Since the expected values of xz, —% and ¥—-, are equal, the expected value of Range/c 
or (x, —2,)/o is twice that of the extreme deviate. Hence 


Mean range 8 [ 
ee ae 


By Gregory’s formula for numerical quadrature we can obtain values of the integrals 
[a.ae, fa.ae by simple summation. The value of the mean range for n = 3 to 9 thus 


obtained should agree reasonably with the exact values given in Table XXII of Tables for 
Statisticians and Biometricians, Part II. Table 8 below presents the values of the mean range 
obtained from a, and from 4@,, alongside the exact values. 


Table 8. Values of mean range (o = 1) 








n Using a, Using a, Exact value 
3 1-69 255 1-691 1-69257 
4 2-0552 2-053 2-05875 
5 2-3236 2-318 2-32593 
6 2-5361 2-518 2-53441 
7 2-7081 2-687 2-70436 
8 2-8504 2-862 2-84720 
9 2-9705 2-99 2-97003 




















Only as many decimals have been retained in columns (2) and (3) of Table 8 ass were avail- 
able for the values of a, and a, in Table 5. The agreement is satisfactory for our purpose. 

Two examples of the use of studentized probability integral of the extreme deviate are 
given below. 

Example 1. This is taken from Snedecor’s Statistical Methods (1946, 4th ed., p. 266). 

A randomized block experiment with four strains of wheat A, B, C, D and five replications 
gave the following mean yield in pounds per plot. 


A B Cc D 
34-4 34-8 33-7 28-4 









































126 Distribution of the extreme deviate from the sample mean 


An interesting feature is the similarity of the first three means. Analysis of variance 
showed significant differences among the four means, as Table 9 will show. 

The variance ratio F for strains against error is 44-82/2-19 = 20-5 which is much larger 
than Foo, = 10-8. As Snedecor says: ‘one suspects that the highly significant F is attribut- 
able largely to the small yield of D’. But according to him ‘no definite probability statements 
can be made about contrasts suggested by the data’. What he means perhaps is that a test 
of significance of the difference between 28-4 and the mean of 34-4, 34-8 and 33-7 by the 
usual t-test 

_ 34-3 28-4 
~ A [2-19G35 +3) 


with 12 degrees of freedom is not valid, as 28-4 is the smallest mean. The appropriate criterion 
in this situation is the studentized extreme deviate which in this case is 


= 7-7, 


Z—2, 32-8—28-4 — 
& (ex 2-19) 





6-7, 


with n = 4and v = 12. Referring to Table 5 (p. 142 below) we find that Q = 6-7 is far beyond 
the limits of the table showing that it is a very exceptional value. 


Table 9. Analysis of variance 











Source of Degrees of Sum of Westen 
variation freedom squares 

Blocks 4 21-46 5°36 
Strains 3 134-45 44-82 
Error 12 26-26 2-19 
Total 19 182-17 — 




















Having thus concluded that the smallest mean 28-4 is significantly smaller than the other 
three means, we are justified in saying that D is definitely inferior to A, Band C. Of course, 
as a general rule, no categorical conclusions can be drawn from the results of a single experi- 
ment and only by repeating the experiment a number of times and seeing whether D turns 
out to give the smallest mean every time can our conclusion from the first results be definitely 
established. 

Example 2. This is artificially built up from Example 1 by changing the error variance 
from 2-19 to 13-00. The latter gives a standard error per plot of 11 % which is not too excessive 
a value to expect in ordinary field experiments. The variance ratio for strains against this 
error is F = 44-82/13-00 = 3-45 which is not significant at the 5% level. The conclusion is 
therefore that there are no significant differences among the means of the four strains 
A, B, C, D. 

But if we compare the smallest mean against the general mean and calculate the student- 
ized extreme deviate 

Z—x, 32:8-28-4 _ 
8 (tx 13-00) © 
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we find from Table 6 (see p. 143 below) that the probability of getting this or a larger value 
when» = 4,v = 12 lies between 0-05 and 0-01. Onthe 5 & level, therefore, 28-4 is significantly 
smaller than the general mean, indicating that D is inferior to A, B and C. Although this is 


an artificially constructed ¢xample, it helps to illustrate a situation which may occasionally 
arise. 


5. Use oF G-FUNCTIONS IN THE DISTRIBUTIONS OF A CLASS OF 
STATISTICS BASED ON ORDERED VARIATES 


Godwin introduced the G-functions primarily to obtain the distribution of the mean 
deviation from the mean. We have seen its use in the distribution of the extreme deviate 
from the mean. We shall now consider certain other statistics based on the ordered variates 
2, ---,%, in whose sampling distributions the G-function appears. The distributions derived 
are in the form of single or double integrals involving the G-functions in the integrand. 
Only by numerical integration using the G-function tables can the probability integrals of 
these distributions be calculated. In many cases where only upper and lower percentage 


points are required, the approximations (27) and (28) to the G-functions may be quite 
adequate. 


Let us consider a general statistic 


6 = (@, +... +%p_g43)/]— (a 4+... +2,)/k, (34) 

where xz, <...<z, andk+Il<n. 
When k = I, 6 is same as the statistic suggested by Jones (1946) for a quick estimation 
of o in certain situations where (say) only 5 % of the observations at the two ends are avail- 


able. As special cases of this statistic we have the range and the mean deviation from the 
median (see, for example, Nair, 1947). 


When k+/ = n, 5 may be written in three different forms: 


1 1 
é = (w—& “= vee +X p41)— 7 (+--+ + Xe) 


= 7 leat. + %y41)/(n—k) —3} 


- <—e- (y+... +2,)/K}. (35) 


When k = (n—1) or 1, the 6 of (35) reduces to the extreme deviate x, —% or —2,, multi- 
plied by the factor n/(n— 1). 


To obtain the distribution of 6 of (34), we start off by introducing the following variates: 


oe Je ) 
z= (tates + Hn), 


= (Gy t---+%paps) t+ (Mit +--+ ~)  (Cegat--- + Zn.) 
y= (k+l). ent 
U; = {i%j44— (Tt Riat-..+%)} (t= 1,...,(k—-1)), 
U = (Hirer — iret ---+2ey)} (6 = 1,....(n—-k-1-1)), 


w, = {(@y +... +2q_ga3)—t%,_,} (6 = 1,..., (0-1). ] 





3 (36) 
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Dividing the n new variates, 6, Z, y, u,;, v;, w; by the square root of the sum of the coefficients 
of x on the right-hand side, we get the following orthogonal system of transformed variates 





iin ein 
whe (k+l) ’ 
Zz’ = ./nZ, 
k+l) (n—k-l 
=| + Ke y, 
37 
i“ Jag (i = 1,...,(k—1)), (37) 





“TEE (i = 1,...,(n—k—-I-1)), 
W; Rs 
‘= e+) (¢ = 1,...,(/—1)). 
It follows that 
n n—k—l-1 i-1 


D (24) = 2+ 82 + y'2 + Dutt x vj? + x wi; 
1 














al (k+1)(n— k- l) Be! uz n—k-I-1 v3 I-1 u? 
=n it n Y Saat > +t Fae ©) 


n k—-1 n—k-—l— l-1 
Ildx, = dz’ dé’ dy’ T] du’, Tl * av TI dw; 
1 1 1 1 


k-1_ n-k-l-1 1-1 
dzdédy[[ du; [I dv; [I dw; 
i 1 i (39) 
(k—1)!(l—1)!(n—k—I-1})! 





The joint distribution of Z, 3, y, u,;, v;, w; can be obtained from the joint distribution (10) 
of z,,...,%, in the form 


n\(2m)-*" 
(= 1)! (T= 1)! (n—k-1-1)! 


lin SN _— 3 n—k—l-1 : i-1 2 
xexp| —3(nz" kl 3 (k+l) (n—k-l) ul v3 wt) 

















2 —— ' 
tern" * n Y+ Gynt » Went =n 
k-1 n—k-—Il-1 l-1 
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Integrating out for Z between the limits +o, the joint distribution of 6, y, u,, v;, w; is 
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To integrate out for y, u,, v; and w, we have to note that corresponding to the inequalities 


2, <...<Z, we now have 
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It is extremely difficult to carry out the integration for y, u;, v; and w,; subject to the 
inequalities (42). In the following speciai cases, however, the last two inequalities in (42) 


take a simpler form and the integration can be carried forward to a certain stage in terms 
of G-functions. 


Case I. k+l =n. Here y and v; disappear and the inequalities (42) reduce to 
O<u,<...<Uy_}, 


0<w,<...< Ww, 


(43) 
1 
purat pMas 6. 


The joint distribution of 6, wu; and w;, is 
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Putting u,_, = ¢ and writing the last inequality in (43) as w,_, <1(d—e/k) we can integrate 
out u; and w; from (44) and obtain the distribution of é in the form 
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where 


d 
G.-a(€) = qe ok- 1(€)= exp| - ay | G-2(€). 


If we had written w,_, = € and u,_,<k(é—e/l), we should get an alternate form which 
is the same as (45) with k and / interchanged. 


Putting / = 1, and dé = nu/(n—1) in (45) we get the distribution of the extreme deviate 
%,, —% given in (19). 


Putting / = 2, which is appropriate for the case of two outlying observations in the same 
direction, the distribution of é takes the form 
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If k =l=m and n = 2m, 8 becomes twice the mean deviation from the median, whose 
distribution has been obtained by Godwin (unpublished). 


Case II. k+1=n-—1. Here v;’s disappear and the inequalities (42) reduce to 
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The joint distribution of 6, y, u,’s and w,’s is 
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Integrating out y, u; and w; from (48) using the inequalities (47) we get the distribution 
of d in the form 
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Putting k = 1 =m and n = 2m+1, 6 becomes n/m times the mean deviation from the 
median whose distribution has been obtained by Godwin (unpublished). If m = 1, in par- 
ticular, d becomes the range in a sample of 3 and we get 
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which is the form given by McKay & Pearson (1933). 
Case III. k+l = n—2. The inequalities become 
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The distribution of 5 comes out in the form of a double integral involving product of two 
G-functions 


_nln- 4(Q7r)-Hn—1) * kl ‘ 
wu =I)! -exp| - 555" | 


“ff. owe la i(gas-7- ar. i{i(5+7-4)fexo| - " 3, 8-7 ar) aye 


Ifn = 2m and k = 1 = m—1, 6 becomes a special case of Jones’s statistic. In particular, if 
m = 2, this reduces to the a in samples of 4 and its distribution becomes 
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Table 1. Probability integral of the extreme deviate (x,,—2)/o or (E— x,)/o 
































tn ‘normal’ samples of size n 
Pe 3 4 5 6 7 8 9 
Uu 
10-* 10-* 10-* 10-* 10-* 10-* 10-* 
0-00 
0-01 124 
0-02 496 10 
0-03 1115 36 
0-04 1 982 87 3 
0-05 3 095 169 9 
0-06 4 453 293 19 1 
0-07 6 056 464 35 2 
0-08 7901 690 59 5 1 
0-09 9 987 979 95 9 1 
0-10 12 312 1 338 145 16 2 
0-11 14 874 1777 212 25 3 
0-12 17 671 2 301 299 39 5 1 
0-13 20 701 2917 410 57 8 1 
0-14 23 960 3 631 549 83 13 2 
0-15 27 446 4451 | 720 116 19 3 
0-16 31 156 5 382 927 159 28 5 
0-17 35 086 6 430 1175 214 39 7 1 
0-18 39 234 7 601 1 468 283 55 10 2 
0-19 43 595 8 901 1812 368 75 15 3 
0-20 48 166 10 334 2 210 472 101 21 5 
0-21 52 943 11 906 2 669 597 134 29 7 
0-22 57 922 13 621 3 192 747 175 41 10 
0-23 63 099 15 483 3 786 924 225 55 13 
0-24 68 469 17 495 4 455 1 132 288 73 18 
0-25 74 028 19 663 5 204 1 375 363 96 25 
0-26 79 772 21 988 6 039 1 656 453 124 34 
0-27 85 696 24 474 6 964 1 978 561 159 45 
0-28 91 794 27 124 7 985 2 346 689 202 59 
0-29 98 063 29 939 9 106 2 765 838 254 77 
0-30 104 497 32 922 10 333 3 237 1013 317 99 
0-31 111 091 36 075 11 670 3 768 1 215 392 126 
0-32 117 840 39 398 13 121 4361 1 448 480 159 
0-33 124 738 42 893 14 691 5 021 1715 585 200 
0-34 131 781 46 560 16 384 5 754 2 018 707 248 
0-35 138 963 50 400 18 205 6 562 2 363 850 306 
0-36 146 279 54 412 20 157 7 451 2 752 1 015 375 
0-37 153 723 58 597 22 244 8 426 3 188 1 205 456 
0-38 161 290 62 954 24 469 9 490 3 677 1 423 551 
0-39 168 975 67 481 26 835 10 649 4 221 1 672 662 
0-40 176 771 72 179 29 346 11 906 4 825 1 954 791 
0-41 184 674 77 045 32 004 13 266 5 493 2 273 940 
0-42 192 677 82 079 34 813 14 734 6 228 2 631 1111 
0-43 200 777 87 277 37 773 16 313 7 036 3 033 1 307 
0-44 208 966 92 638 40 887 18 007 7921 3 482 1 530 
0-45 217 239 98 159 44 157 19 821 8 886 3 981 1783 
0-46 225 591 103 838 47 584 21 758 9 936 4 535 2 069 
0-47 234 017 109 672 51 169 23 822 11 076 5 147 2 390 
0-48 242 512 115 658 54 913 26 015 12 309 5 820 2751 
0-49 251 069 121 793 58 816 28 342 13 640 6 560 3 154 
0-50 259 684 128 073 62 880 30 805 15 073 7 370 3 602 


























































Table 1 (cont.). Probability integral of the extreme deviate (x,,—Z)/o or (E—2,)/o 














in ‘normal’ samples of size n 
oe 3 4 . 6 7 8 9 
u 
10-* 10-* 10-* 10-* 10-* 10-* 10-* 
0-50 259 684 128 073 62 880 30 805 15 073 7 370 3 602 
0-51 268 351 134 495 67 103 33 407 16 611 8 254 4 099 
0-52 277 066 141 054 71 487 36 151 18 259 9 216 4 649 
0-53 285 823 147 748 76 029 39 039 20 021 10 260 5 255 
0-54 294 616 154 572 80 730 42 073 21 899 11 391 5 922 
0-55 303 442 161 522 85 589 45 255 23 899 12 612 6 652 
0-56 312 295 168 594 90 604 48 587 26 023 13 928 7 450 
0-57 321 170 175 782 95 774 52 069 28 275 15 343 8 321 
0-58 330 063 183 084 101 097 55 705 30 657 16 860 9 267 
0-59 338 969 190 494 106 572 59 493 33 173 18 484 10 294 
0-60 347 883 198 008 112 195 63 436 35 825 20 218 11 404 
0-61 356 801 205 621 117 965 67 534 38 616 22 066 12 602 
0-62 365 720 213 328 123 879 71 786 41 549 24 032 13 893 
0-63 374 633 221 124 129 935 76 193 44 625 26 118 15 279 
0-64 383 538 229 006 136 129 80 754 47 846 28 329 16 766 
0-65 392 430 236 967 142 459 85 468 51 214 30 668 18 356 
0-66 401 305 245 003 148 921 90 334 54 730 33 137 20 054 
0-67 410 159 253 110 155 511 95 352 58 396 35 740 21 863 
0-68 418 989 261 283 162 227 100 521 62 213 38 478 23 787 
0-69 427 791 269 516 169 064 105 838 66 180 41 355 25 830 
0-70 436 562 277 805 176 019 111 302 70 300 44 373 27 995 
0-71 445 298 286 145 183 088 116 912 74 572 47 534 30 285 
0-72 453 996 294 532 190 266 122 666 78 996 50 839 32 703 
0-73 462 652 302 960 197 550 128 560 83 571 54 290 35 253 
0-74 471 264 311 425 204 935 134 593 88 298 57 889 37 936 
0-75 479 829 319 923 212 417 140 761 93 176 61 637 40 756 
0-76 488 344 328 448 219 992 147 062 98 203 65 535 43 715 
0-77 496 805 336 997 227 655 153 493 103 380 69 583 46 814 
0-78 505 211 345 564 235 402 160 050 108 703 73 781 50 057 
0-79 513 559 354 147 243 228 166 731 114 172 78 131 53 444 
0-80 521 847 362 739 251 129 173 531 119 785 82 632 56 978 
0-81 530 072 371 337 259 100 180 447 125 540 87 284 60 660 
0-82 538 232 379 938 267 137 187 476 131 434 92 086 64 490 
0-83 546 325 388 536 275 235 194 613 137 466 97 038 68 471 
0-84 554 349 397 129 283 390 201 855 143 632 102 138 72 601 
0-85 562 303 405 711 291 597 209 197 149 930 107 386 76 883 
0-86 570 184 414 280 299 851 216 636 156 357 112 780 81315 
0-87 577 991 422 831 308 149 224 167 162 910 118 319 85 899 
0-88 585 722 431 362 316 484 231 786 169 585 124 000 90 633 
0-89 593 376 439 868 524 854 239 488 176 380 129 822 95 517 
0-90 600 951 448 346 333 254 247 270 183 290 135 783 100 550 
0-91 608 446 456 793 341 679 255 127 190 313 141 880 105 732 
0-92 615 860 465 206 350 125 263 054 197 444 148 111 111 061 
0-93 623 192 473 581 358 588 271047 204 680 154 472 116 536 
0-94 630 441 481 917 367 063 279 102 212 016 160 961 122 154 
0-95 637 606 490 210 375 547 287 214 219 449 167 575 127 913 
0-96 644 686 498 457 384 035 295 379 226 974 174 310 133 811 
0-97 651 680 506 656 392 523 303 591 234 587 181 164 139 848 
0-98 658 588 514 803 401 008 311 848 242 285 188 132 146 021 
0-99 665 408 522 895 409 486 320 143 250 062 195 211 152 329 
1-00 672 142 530 930 417 952 328 474 257 914 202 397 158 771 





















































Table 1 (cont.). Probability integral of the extreme deviate (x,,—%)|o or (E—2,)/o 
































in ‘normal’ samples of size n 
is 3 4 5 6 7 8 9 
10-* 10-* 10-* 10-* 10-* 10-* 10-* 
1-00 672 142 530 930 417 952 328 474 257 914 202 397 158 771 
1-01. 678 787 538 909 426 404 336 835 265 838 209 687 165 335 
1-02 685 344 546 827 434 838 345 222 273 827 217 076 172 023 
1-03 691 812 554 683 443 250 353 632 281 879 224 561 178 832 
1-04 698 191 562 474 451 636 362 059 289 989 232 136 185 758 
1-05 704 481 570 199 459 994 370 499 298 151 239 799 192 798 
1-06 710 682 577 856 468 321 378 949 306 362 247 544 199 947 
1-07 716 793 585 443 476 613 387 405 314 618 255 368 207 203 
1-08 722 815 592 959 484 867 395 861 322 913 263 266 214 561 
1-09 728 748 600 402 493 080 404 316 331 244 271 234 222 018 
1-10 734 592 607 770 501 250 412 764 339 606 279 267 229 568 
1-11 740 346 615 064 509 374 421 202 347 995 287 360 237 209 
1-12 746 O11 622 280 517 449 429 626 356 406 295 510 244 935 
1-13 751 588 629 418 525 472 438 032 364 835 303 712 252 743 
1-14 757 O77 636 478 533 442 446 418 373 278 311 961 260 627 
1-15 762 477 643 458 541 356 454 780 381 732 320 253 268 585 
1-16 767 790 650 356 549 212 463 114 390 191 328 583 276 610 
1-17 773 015 657 173 557 007 471 417 398 652 336 948 284 700 
1-18 7178 154 663 908 564 740 479 686 407 110 345 342 292 848 
1-19 783 206 670 559 572 408 487 918 415 563 353 761 301 052 
1-20 788 172 677 127 580 010 496 110 424 006 362 202 309 305 
1-21 793.053 683 611 587 545 504 259 432 435 370 659 317 604 
1-22 797 849 690 010 595 009 512 363 440 847 379 128 325 945 
1-23 802 561 696 324 602 403 520 419 449 239 387 606 334 322 
1-24 807 190 702 552 609 724 528 423 457 606 396 088 342 731 
1-25 811 735 708 695 616 971 536 375 465 946 404 570 351 169 
1-26 816 199 714 752 624 143 544 271 474 255 413 049 359 629 
1-27 820 581 720 723 631 238 552 109 482 530 421 520 368 109 
1-28 824 882 726 608 638 256 559 887 490 767 429 979 376 604 
1-29 829 104 732 407 645 195 567 603 498 965 438 424 385 109 
1-30 833 246 738 120 652 055 575 255 507 120 446 849 393 621 
1-31 837 309 743 746 658 834 582 841 515 229 455 252 402 135 
1-32 841 295 749 287 665 531 590 359 523 290 463 629 410 647 
1-33 845 205 754 743 672 147 597 808 531 300 471 978 419 153 
1-34 849 038 760 112 678 680 605 185 539 256 480 293 427 650 
1-35 852 796 765 397 685 131 612 491 547 156 488 573 436 133 
1-36 856 479 770 596 691 497 619 722 554 998 496 814 444 599 
1-37 860 090 775 711 697 779 626 878 562 780 505 014 453 044 
1-38 863 628 780 742 703 977 633 958 570 499 513 168 461 465 
1-39 867 094 785 688 710 089 640 960 578 154 521 276 469 858 
1-40 870 489 790 552 716 117 647 884 585 742 529 333 478 219 
1-41 873 814 795 333 722 059 654 727 593 262 537 337 486 546 
1-42 877 071 800 031 727 916 661 490 600 712 545 286 494 835 
1-43 880 259 804 647 733 688 668 172 608 090 553 178 503 084 
1-44 883 381 809 183 739 374 674 771 615 396 561 010 511 288 
1-45 886 436 813 637 744 975 681 288 622 627 568 779 519 446 
1-46 889 425 818 012 750 490 ‘687 722 629 782 576 485 527 554 
1-47 892 351 822 307 755 920 694 071 636 859 584 124 535 610 
1-48 895 213 826 524 761 265 700 336 643 859 591 695 543 611 
1-49 898 012 830 663 766 525 706 516 650 779 599 197 551 556 
1-50 900 750 834 724 771 701 712 611 657 619 “606 627 559 440 




















Table 1 (cont.). Probability integral of the extreme deviate (x, —%)/o or (E—2,)/o 
in ‘normal’ samples by size n 
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~ 3 6 7 8 9 
u 
10-8 10- 10-6 10-6 10-# 10- 10-* 
1-50 | 900750 | 834724 | 771701 | 712611 | 657619 | 606627 | 559440 
1-51 | 903428 | 838710 | 776792 | 718621 | 664377 | 613983 | 567 262 
1-52 | 906045 | 842619 | 781800 | 724545 | 671053 | 621265 | 575021 
153 | 908604 | 846453 | 786724 | 730383 | 677647 | 628471 | 582713 
1:54 | 911105 | 850214 | 791565 | 736136 | 684156 | 635600 | 590337 
1:55 | 913550 | 853901 | 796324 | 741803 | 690582 | 642650 | 597892 
1:56 | 915938 | 857515 | 801000 | 747384 | 696923 | 649620 | 605374 
1-57 | 918271 | 861058 | 805595 | 752879 | 703179 | 656509 | 612783 
158 | 920550 | 864531 | 810109 | 758289 | 709349 | 663317 | 620117 
1-59 | 922775 | 867933 | 814543 | 763613 | 715433 | 670042 | 627375 
1-60 | 924949 | 871266 | 818897 | 768852 | 721431 | 676684 | 634555 
1-61 | 927071 | 874531 | 823172 | 774007 | 727343 | 683241 | 641656 
1-62 | 929142 | 877728 | 827368 | 779076 | 733169 | 689714 | 648677 
1-63 | 931164 | 880859 | 831487 | 784062 | 738908 | 696101 | 655616 
1-64 | 933137 | 883924 | 835529 | 788964 | 744560 | 702402 | 662473 
1-65 | 935062 | 886925 | 839494 | 793783 | 750126 | 708617 | 669246 
1-66 | 936940 | 889862 | 843384 | 798518 | 755605 | 714745 | 675935 
1-67 | 938772 | 892737 | 847199 | 803172 | 760999 | 720786 | 682540 
1-68 | 940559 | 895549 | 850941 | 807743 | 766306 | 726740 | 689058 
1-69 | 942301 | 898300 | 854609 | 812233 | 771527 | 732607 | 695491 
1-70 | 944000 | 900991 | 858205 | 816643 | 776663 | 738387 | 701837 
1-71 | 945656 | 903623 | 861729 | 820973 | 781714 | 744078 | 708095 
1-72 | 947270 | 906197 | 865182 | 825223 | 786680 | 749683 | 714266 
1-73 | 948843 | 908713 | 868566 | 829395 | 791561 | 755200 | 720349 
1-74 | 950376 | 911172 | 871881 833488 | 796359 | 760630 | 726344 
1:75 | 951870 | 913577 | 875128 | 837505 | 801073 | 765973 | 732251 
1:76 | 953324 | 915926 | 878308 | 841445 | 805704 | 771229 | 738069 
1:77 | 954741 | 918222 | 881421 | 845309 | 810253 | 776398 | 743799 
1-78 | 956121 | 920465 | 884469 | 849099 | 814720 | 781482 | 749440 
1-79 | 957464 | 922656 | 987453 | 852814 | 819106 | 786479 | 754993 
1:80 | 958772 | 924795 | 890373 | 856456 | 823411 791391 | 760458 
1-81 | 960045 | 926885 | 893230 | 860025 | 827637 | 796219 | 765834 
1-82 | 961284 | 928925 | 896026 | 863523 | 831783 | 800961 | 771123 
1-83 | 962489 | 930917 | 898760 | 866950 | 835851 | 805620 | 776324 
1-84 | 963662 | 932861 | 901435 | 870308 | 839842 | 810196 | 781438 
1:85 | 964803 | 984759 | 904051 | 873596 | 843756 | 814689 | 786466 
1:86 | 965913 | 936610 | 906608 | 876816 | 847593 | 819099 | 791407 
1:87 | 966992 | 938417 | 909109 | 879969 | 851356 823429 | 796261 
1-88 | 968042 | 940180 | 911553 | 883056 | 855044 | 827677 | 801031 
1:89 | 969062 | 941899 | 913942 | 836077 | 858658 | 831846 | 805715 
1:90 | 970054 | 943576 | 916276 | 889034 | 862200 | 835935 | 810315 
1-91 | 971018 | 945211 | 918657 | 891927 | 865670 | 839945 | 814839 
1-92 | 971954 | 946805 | 920785 | 894757 | 869068 | 843878 | 819965 
1:93 | 972864 | 948359 | 922962 | 897526 | 872397 | 847734 | 893616 
1:94 | 973748 | 949874 | 925087 | 900234 | 875657 | 851514 | 897 885 
1:95 | 974607 | 951350 | 927163 | 902882 | 878848 | g55219 | 992073 
1:96 | 975441 | 952789 | 929189 | 905471 881972 | 858849 | 836181 
1-97 | 976251 | 954190 | 931168 | 908002 | sg5029 | 862405 | 940909 
1:98 | 977037 | 955556 | 933099 | 910476 | 888021 | 865889 | 844 159 
1-99 | 977800 | 956886 | 934983 | 912894 | 890949 | 869301 | 848031 
2-00 | 978541 | 958181 | 936.822 | 915257 | 893813 | 872642 | 951896 

















Table 1 (cont.). Probability integral of the extreme deviate (x,,—2)|o or (—2,)/o 
































in ‘normal’ samples of size n 
n 
Peg 3 4 7 6 7 8 9 
10-* 10-* 10-* 19-* 10-* 10-* 10-* 
2-00 978 541 958 181 936 822 915 257 893 813 872 642 851 826 
2-01 979 260 959 442 938 616 917 566 896 614 875 913 855 544 
2-02 979 958 960 670 940 366 919-821 899 353 879 116 859 188 
2-03 980 635 961 866 $42 073 922 023 902 032 882 250 862 757 
2-04 981 291 963 030 943 738 924 174 904 650 885 317 866 252 
2-05 981 928 964 162 945 362 926 274 907 210 888 318 862 675 
2-06 982 545 965 265 946 945 928 325 909 712 891 253 873 027 
2-07 983 144 966 337 948 488 930 326 912 157 894 124 876 307 
2-08 983 724 967 380 949 992 932 280 914 545 896 932 879 518 
2-09 984 286 968 395 951 458 934 187 916 879 899 678 882 661 
2-10 984 832 969 382 952 886 936 047 919 158 902 362 885 735 
2-11 985 360 970 342 954 278 937 862 921 384 904 986 888 742 
2-12 985 872 971 275 955 633 939 632 923 558 907 550 891 684 
2-13 986 367 972 182 956 954 941 359 925 680 910 056 894 561 
2-14 986 847 973 064 958 240 943 043 927 752 912 504 897 373 
2-15 987 312 973 921 959 493 944 685 929 775 914 896 900 123 
2-16 987 763 974 754 960 712 946 286 931 748 917 232 902 811 
2:17 988 198 975 563 961 899 947 846 933 674 919 514 905 438 
2-18 988 620 976 349 963 055 949 367 935 553 921 741 908 005 
2-19 989 029 977 113 964 180 950 850 937 386 923 916 910 513 
2-20 989 424 977 855 965 274 952 294 939 173 926 040 912 963 
2-21 989 806 978 575 966 339 953 701 940 917 928 112 915 355 
2-22 990 176 979 275 967 375 955 072 942 617 930 134 917 692 
2-23 990 534 979 954 968 383 956 407 944 274 932 107 919 974 
2-24 990 880 980 613 969 364 957 708 945 890 934 032 922 201 
2-25 991 214 981 253 970 317 958 974 947 465 935 910 924 375 
2-26 991 538 981 874 971 244 960 207 949 000 937 742 926 498 
2-27 991 851 982 476 972 145 961 407 950 496 939 528 928 568 
2-28 992 153 983 061 973 022 962 575 951 953 941 270 930 589 
2:29 992 445 983 628 973 873 963 712 953 373 942 968 932 560 
2-30 992 727 984 178 974 701 964 819 954 756 944 623 934 483 
2-31 992 999 984 711 975 505 965 896 956 102 946 236 936 358 
2-32 993 263 985 228 976 287 966 943 957 414 947 808 938 187 
2-33 993 517 985 730 977 046 967 962 958 691 949 340 939 970 
2-34 993 763 986 216 977 784 968 953 959 934 950 832 941 708 
2°35 994 000 986 687 978 500 969 916 961 144 952 286 943 402 
2-36 994 229 987 144 979 196 970 853 962 322 953 702 945 053 
2:37 994 450 987 587 979 871 971 765 963 468 955 081 946 662 
2-38 994 663 988 015 980 527 972 650 964 583 956 424 948 230 
2-39 994 869 988 431 981 164 973 511 965 668 957 732 949 758 
2-40 995 067 988 833 981 782 974 348 966 723 959 005 $51 245 
2-41 995 259 989 223 982 381 975 161 967 750 960 243 $52 694 
2-42 995 443 989 600 982 963 975 951 968 748 961 449 954 105 
2-43 995 621 989 966 983 528 976 718 969 719 962 622 955 479 
2-44 995 793 990 320 984 075. 977 464 970 663 963 764 956 817 
2-45 995 959 990 662 984 607 978 188 971 581 964 875 958 119 
2-46 996 118 930 993 985 122 978 891 972 473 965 955 959 386 
2-47 996 272 991 314 985 622 979 574 973 340 967 006 960 620 
2-48 996 420 991 625 986 106 980 237 974 183 968 028 961 820 
2-49 996 563 991 925 986 576 980 881 975 001 969 021 962 987 
2-50 996 701 992 215 987 031 98. 305 975 797 969 987 964 123 














Table 1 (cont.). Probability integral of the extreme deviate (2,,—2)/o or (— x,)/0 
in ‘normal’ samples of size n 




















ines, Se 4 5 eos : 
u 
10-4 10-# i0-# 10-* 10-# 10-# 10-* 
2-50 | 996701 | 992215 | 987031 | 981505 | 975797 | 969987 | 964123 
251 | 996833 | 992496 | 987473 | 982112 | 976569 | 970926 | 965228 
2-52 | 996961 | 992768 | 987901 | 982700 | 977320 | 971839 | 966 303 
253 | 997084 | 993031 | 988315 | 983271 | 978049 | 972726 | 967347 
2-54 | 997202 | 993285 | 988717 | 983825 | 978757 | 973588 | 968 363 
2:55 | 997316 | 993530 | 989106 | 984362 | 979444 | 974426 | 969351 
2-56 | 997425 | 993768 | 989483 | 984883 | 980111 | 975240 | 970311 
2-57 | 997531 | 993997 | 989848 | 985389 | 980759 | 976030 | 971 244 
258 | 997632 | 994219 | 990201 | 985879 | 981387 | 976798 | 972151 
2-59 | 997730 | 994433 | 990544 | 986354 | 981998 | 977544 | 973.032 
2-60 | 997824 | 994640 | 990875 | 986815 | 982590 | 978268 | 973 889 
2-61 | 997914 | 994840 | 991196 | 987261 | 983164 | 978971 | 974720 
2-62 | 998001 | 995033 | 991506 | 987694 | 983721 | 979653 | 975528 
2-63 | 998084 | 995219 | 991807 | 988113 | 984262 | 980316 | 976313 
2-64 | 998165 | 995399 | 992098 | 988520 | 984786 | 980959 | 977074 
2-65 | 998242 | 995573 | 992379 | 9ssoi4 | 985294 | 981583 | 977814 
2-66 | 998316 | 995740 | 992651 | 989295 | 985787 | 982188 | 978533 
2-67 | 998387 | 995902 | 992915 | 989665 | 986265 | 982776 | 979 230 
2-68 | 998456 | 996058 | 993169 | 990022 | 986728 | 983346 | 979907 
2-69 | 998521 | 996209 | 993416 | 990369 | 987178 | 983898 | 980 563 
2-70 | 998585 | 996355 | 993654 | 990705 | 987613 | 984434 | 981 201 
2-71 | 998645 | 996495 | 993884 | 991029 | 988035 | 984954 | 961 819 
2-72 998 703 996 630 994 107 991 344 988 443 985 458 982 419 
2-73 | 998759 | 996761 | 994322 | 991648 | 988839 | 985947 | 983001 
2-74 | 998813 | 996886 | 994530 | 991943 | 939223 | 986421 | 983 566 
2-75 | 998865 | 997008 | 994731 | 992228 | 989594 | 9s6sso | 9g4 113 
2-76 | 998914 | 997125 | 994925 | 992504 | 939954 | 987325 | 984 644 
2-77 | 998961 | 997237 | 995112 | 992771 | 990303 | 987756 | 985 159 
2-78 | 999007 | 997346 | 995293 | 993029 | 990640 | 988174 | 985658 
2-79 | 999050 | 997451 | 995468 | 993 279 | 990967 | 988.570 | 986 14 
2-80 | 999092 | 997551 | 995637 | 993520 | 991283 | 988971 | 986610 
2-81 999 132 997 649 995 800 993 754 991 589 989 351 987 064 
2-82 999 171 997 742 995 958 993 979 991 885 989 719 987 505 
2-83 | 999208 | 997832 | 996110 | 994198 | 992172 | 990075 | 987931 
284 | 999243 | 997919 | 996257 | 994408 | 992449 | 990420 | 988 344 
2°85 999 277 998 003 996 399 994 612 992 717 990 754 988 745 
2-86 | 999309 | 998083 | 996535 | y94809 | 992977 | 991077 | 989132 
2-87 | 999340 | 993161 | 996667 | 995000 | 993228 | 991390 | 989.508 
2-88 999 370 998 235 996 795 995 184 993471 | 991 693 989 871 
2-89 999 399 998 307 996 917 995 361 993 705 | 991 986 990 223 
2-90 | 999426 | 998376 | 997036 | 995533 | 993932 | 992269 | 990564 
2-91 999 452 998 442 997 150 995 699 994 152 992 543 990 894 
2:92 | 999477 | 998506 | 997260 | 995859 | 994364 | 992809 | 991 213 
2-93 | 999501 | 998 568 | 997366 | g96014 | 994569 | 993065 | 991 522 
2-94 | 999524 | 998627 | 997469 | 996163 | 994767 | 993314 | 991 821 
2:95 999 546 998 683 997 567 996 307 994 959 993 554 992 111 
2-96 999 567 998 738 997 663 996 446 995 143 993 786 992 390 
2-97 999 587 998 790 997 754 996 580 995 322 $94 010 992 661 
2:98 999 606 998 841 997 842 996 710 995 495 994 227 992 923 
2-99 | 999625 | 998889 | 997928 | 996835 | 995662 | 994437 | 993 176 
3-00 | 999642 | 998936 | 998010 | 996955 | 995823 | 994cs0 | 993 421 





















































Table 1 (cont.). Probability integral of the extreme deviate (x, —2)/o or (Z—2z,)/o 
in ‘normal’ samples of size n 

















ig aa 3 4 5 6 7 8 9 
u \ 
10-* 10-* 10-* 10-* 10-* 10+ 10-* 
3-00 | 999642 | 998936 | 998010 | 996955 | 995823 | 994639 | 993491 
3-01 | 999659 | 998981 | 998088 | 997072 | 995978 | 994835 | 993 658 
3-02 | 999675 | 999024 | 998164 | 997184 | 996128 | 995024 | 993887 
3-03 | 999690 | 999065 | 998238 | 997292 | 996273 | 995207 | 994 108 
3-04 | 999705 | 999105 | 998308 | 997396 | 996413 | 995383 | 994 399 
3-05 | 999719 | 999143 | 998376 | 997497 | 996548 | 995554 | 994598 
3-06 | 999732 | 999179 | 998441 | 997594 | 996678 | 995718 | 994798 
3-07 | 999745 | 999215 | 998504 | 997687 | 996804 | 995877 | 994991 
3-08 | 999757 | 999248 | 998565 | 997777 | 996925 | 996031 | 995107 
3-09 | 999769 | 999281 | 998623 | 997864 | 997043 | 996179 | 995987 
3-10 | 999780 | 999312 | 998679 | 997948 | 997155 | 996322 | 995461 
3-11 | 999791 | 999341 | 998733 | 998029 | 997264 | 996460 | 995699 
3-12 | 999801 | 999370 | 998785 | 998106 | 997369 | 996594 | 995 792 
3-13 | 999810 | 999397 | 998834 | 998181 | 997471 | 996722 | 995948 
3-14 | 999820 | 999424 | 998ss2 | 998253 | 997568 | 996846 | 996099 
3-15 | 999829 | 999449 | 998929 | g9ss22 | 997662 | 996966 | 996245 
3-16 | 999837 | 999473 | 998973 | 998389 | 997753 | 997082 | 996 386 
3-17 | 999845 | 999496 | 999015 | 998454 | 997840 | 997193 | 996599 
3-18 | 999853 | 999519 | 999056 | 998515 | 997925 | 997301 | 996653 
3-19 | 999860 | 999540 | 999096 | 998575 | 998006 | 997404 | 996780 
3-20 | 999867 | 999560 | 999134 | g9s6s2 | g9s0sa | 997504 | 996902 
3-21 | 999873 | 999580 | 999170 | 9986ss | 998159 | 997600 | 997020 
3-22 | 999880 | 999599 | 999205 | 998741 | 998232 | 997693 | 997133 
3-23 | 999886 | 999617 | 999238 | 998792 | 998302 | 997783 | 9972943 
3-24 | 999891 | 999634 | 999270 | 998841 | 998369 | 997869 | 997349 
3-25 | 999897 | 999650 | 999301 | 99ssss | 998434 | 997952 | 997451 
3-26 | 999902 | 999666 | 999331 | 998934 | 998497 | 998032 | 997549 
3-27 | 999907 | 999681 | 999359 | 998978 | 998557 | 998109 | 997 644 
3-28 | 999912 | 999696 | 999387 | 999020 | 998615 | 998184 | 997735 
3-29 | 999916 | 999709 | 999413 | 999060 | 998670 | 998255 | 997893 
3-30 | 999920 | 999723 | 999438 | 999099 | 998724 | 998394 | 997908 
3-31 | 999924 | 999735 | 999462 | 999136 | 998775 | 998391 | 997989 
3-32 | 999928 | 999747 | 999486 | 999172 | 998825 | 998455 | 998068 
3-33 | 999932 | 999759 | 999508 | 999207 | 998873 | 998516 | 998 144 
3-34 | 999935 | 999770 | 999529 | 999240 | 998919 | 998575 | 998917 
3-35 | 999939 | 999781 | 999550 | 999272 | 998963 | 998633 | 998287 
3-36 | 999942 | 999791 | 999569 | 999302 | 999005 | 998687 | 998 355 
3-37 | 999945 | 999801 | 999588 | 999332 | 999046 | 998740 | 998 490 
3-38 | 999948 | 999810 | 999606 | 999360 | 999085 | 998791 | 998.483 
3-39 | 999951 | 999819 | 999624 | 999387 | 999193 | 998840 | 998 544 
3-40 | 999953 | 999827 | 999640 | 999413 | 999159 | 998887 | 998 602 
3-41 | 999956 | 999835 | 999656 | 999438 | 999194 | 998932 | 998658 
3-42 | 999958 | 999843 | 999671 | 999462 | 999298 | 998976 | 998719 
3-43 | 999960 | 999850 | 999686 | 999485 | 999260 | 999018 | 998 764 
3-44 | 999962 | 999857 | 999700 | 999507 | 999291 | 999058 | 998813 
3-45 | 999964 | 999864 | 999713 | 999528 | 999320 | 999097 | 998862 
3-46 | 999966 | 999871 | 999726 | 999549 | 999349 | 999134 | 998908 
3-47 | 999968 | 999877 | 999738 | 999568 | 999376 | 999169 | 998 952 
3-48 | 999970 | 999883 | 999750 | 999587-| 999403 | 999204 | 998 995 
3-49 | 999971 | 999883 | 999761 | 999605 | 999428 | 999237 | 999036 
3-50 | 999973 | 999804 | 999772 | 999622 | 999452 | 999269 | 999076 



































in ‘normal’ samples of size n 


Table 1 (cont.). Probability integral of the extreme deviate (x,,—%)/o or (—2,)/o 









































































aw 3 4 5 6 7 8 9 
u 
10-# 10-8 10-* 10-# 10-* 10-* 10-* 
3-50 999 973 999 894 999 772 999 622 999 452 999 269 999 076 
3-51 999 974 999 899 999 783 999 638 999 476 999 299 999 114 
3-52 999 976 999 904 999 792 999 654 999 498 999 328 999 150 
3-53 999 977 999 08 999 802 999 669 999 519 999 357 999 135 
3-54 999 978 999 913 999 811 999 684 999 540 999 384 999 219 
3-55 999 979 999 917 999 820 999 698 999 560 999 410 999 251 
3-56 999 981 999 921 999 828 999 711 999 579 999 435 999 282 
3-57 999 982 999 925 999 836 999 724 999 597 999 458 999 312 
3-58 999 983 999 929 999 843 999 736 999 614 999 481 999 341 
3-59 999 984 999 932 999 851 999 748 999 631 999 503 999 369 
3-60 999 985 999 935 999 858 999 759 999 647 999 525 999 395 
3-61 999 985 999 939 999 864 999 770 999 662 999 545 999 421 
3-62 999 986 999 942 999 870 999 780 999 677 999 564 999 445 
3-63 999 987 999 945 999 876 999 790 999 691 999 583 999 469 
3-64 999 988 999 947 999 882 999 800 999 705 999 601 999 491 
3-65 999 988 999 950 999 888 999 809 999 718 999 618 999 513 
3-66 999 989 999 952 999 893 999 817 999 730 999 635 999 533 
3-67 999 990 999 955 999 898 999 826 999 742 999 651 999 553 
3-68 999 990 999 957 999 903 999 834 999 754 999 666 999 573 
3-69 999 991 999 959 999 908 999 841 999 765 999 680 999 591 
3-70 999 991 999 961 999 912 999 848 999 775 999 694 999 609 
3-71 999 992 999 963 999 916 999 855 999 785 999 708 999 625 
3-72 999 992 999 965 999 $20 999 862 999 795 999 720 999 642 
3-73 999 993 999 967 999 924 999 868 999 804 999 733 999 657 
3-74 999 993 999 968 999 928 999 874 999 813 999 745 999 672 
| 3-75 999 994 999 970 999 931 999 880 999 821 999 756 999 686 
3-76 999 994 999 972 999 934 999 886 999 829 999 767 999 700 
3-77 999 994 999 973 999 938 999 891 999 837 999 777 999 713 
3-78 999 995 999 974 999 941 999 896 999 844 999 787 999 726 
3-79 999 995 999 976 999 943 999 901 999 852 999 796 999 738 
3-80 999 995 999 977 999 946 999 906 999 858 999 806 999 749 
3-81 999 995 999 978 999 949 999 910 999 865 999 814 999 760 
3-82 999 996 999 979 999 951 999 914 999 871 999 823 999 771 
3-83 999 996 999980 | 999954 999 918 999 877 999 831 999 781 
3-84 999 996 999 981 999 956 999 922 999 883 999 838 999 791 
3-85 999 996 999 982 999 958 999 926 999 888 999 846 999 800 
3-86 999 997 999 983 999 960 999 929 999 893 999 852 999 809 
3-87 999 997 999 984 999 962 999 933 999 898 999 859 999 817 
3-88 999 997 999 985 999 964 999 936 999 903 999 866 999 826 
3-89 999 997 999 986 999 966 999 939 999 907 999 872 999 834 
3-90 999 997 999987 | 999968 999 942 999 912 999 878 999 841 
3-91 999 997 999 987 999 969 999 945 999 916 999 883 999 848 
| 3-92 999 998 999 988 999 971 999 947 999 920 999 889 999 855 
3-93 999 998 999 989 999 972 999 950 999 924 999 894 999 862 
3-94 999 998 999 989 999 974 999 952 999 927 999 899 999 868 
3-95 999 998 999 990 999 975 999 955 999 931 999 903 999 874 
3-96 999 998 999 990 999 976 999 957 999 934 999 908 999 880 
3-97 999 998 999 991 999 977 999 959 999 937 999 912 999 885 
| 3-98 999 998 909 991 999 979 999 961 999 940 999 916 999 890 
| 3-99 999 998 ¥99 992 999 980 999 963 999 943 999 920 999 895 
4-00 999 999 999 992 999 981 999 965 999 946 999 924 999 900 
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Table 1 (cont.). Probability integral of the extreme deviate (x, —2%)/o or (—2,)/o 



































in ‘normal’ samples of size n 
eo 3 4 5 6 7 8 9 
uU 
10-* 10-* 10-* 10-* 10-* 10-* 10-* 
4-00 999 999 999 992 999 981 999 965 999 946 999 924 999 900 
4-01 999 999 999 993 999 982 999 966 999 948 999 927 999 905 
4-02 999 999 999 993 999 983 999 968 989 951 999 931 999 909 
4-03 999 999 999 993 999 983 999 970 999 953 999 934 999 913 
4-04 999 999 999 994 999 984 999 971 999 955 999 937 999 917 
4-05 999 999 999 994 999 985 999 973 999 958 999 940 999 921 
4-06 999 999 999 994 999 986 999 974 999 960 999 943 999 925 
4-07 995 999 999 995 999 987 999 975 999 962 999 946 999 928 
4-08 999 999 999 995 999 987 999 976 999 964 999 948 999 932 
4-09 999 999 999 995 999 988 999 978 999 965 999 951 999 935 
4-10 999 999 999 996 999 989 999 979 999 967 999 953 999 938 
4-11 999 999 999 996 999 989 999 980 999 969 999 955 999 941 
4-12 999 999 999 996 999 990 999 981 999 970 999 957 999 944 
4-13 999 999 999 996 999 990 999 982 999 972 999 959 999 946 
4-14 999 999 999 996 999 991 999 983 999 973 999 961 999 949 
415 | 1-000 000 999 997 999 991 999 984 999 975 999 963 999 951 
4-16 999 997 999 992 999 984 999 976 999 965 999 954 
4:17 999 997 999 992 999 985 999 977 999 967 999 956 
4-18 999 997 999 993 999 986 999 978 999 968 999 958 
4-19 999 997 999 993 999 987 999 979 999 970 999 S60 
4-20 999 997 999 993 999 987 999 980 999 971 999 962 
4-21 999 998 999 994 999 988 999 981 999 973 999 964 
4-22 999 998 999 994 999 989 999 982 999 974 999 965 
4-23 999 998 999 994 999 989 999 983 999 975 999 967 
4:24 999 998 999 995 999 990 999 984 999 977 999 969 
4-25 999 998 999 995 999 990 999 985 999 978 999 970 
4-26 999 998 999 995 999 991 999 986 999 979 999 971 
4:27 999 998 999 996 999 991 999 986 999 980 999 973 
4-28 999 998 999 996 999 992 999 987 999 981 999 974 
4-29 999 998 999 996 999 992 999 988 999 982 999 975 
4-20 999 999 999 996 999 993 999 988 999 983 999 977 
4-31 999 999 999 996 999 993 999 989 999 983 999 978 
4:32 999 999 999 997 999 993 999 990 999 984 999 979 
4-33 999 999 999 997 999 994 999 990 999 985 999 980 
4-34 999 999 999 997 999 994 999 991 999 $86 999 981 
4-35 999 999 999 997 999 994 999 991 999 987 999 982 
4-36 999 999 999 997 999 995 999 992 999 987 999 983 
4-37 999 999 999 997 999 995 999 992 999 988 999 983 
4-38 999 999 999 998 999 995 999 992 999 988 999 984 
4-39 999 999 999 998 999 995 999 993 999 989 999 985 
4-40 999 999 999 998 999 996 999 993 999 990 999 986 
4-41 999 999 999 998 999 996 999 994 999 990 999 986 
4-42 999 $99 999 998 999 996 999 994 999 991 999 987 
4-43 999 999 999 998 999 996 999 994 999 991 999 988 
4-44 999 999 999 998 999 996 999 995 999 992 999 988 
4-45 999 999 999 998 999 997 999 995 999 992 999 989 
4-46 999 999 999 998 999 997 999 995 999 992 999 989 
4-47 999 999 999 999 999 997 999 996 999 993 999 990 
4-48 999 999 999 999 999 997 999 996 999 993 999 991 
4-49 999 999 999 999 999 997 999 996 999 993 999 991 
4-50 999 999 999 999 999 998 999 996 999 994 999 992 



















in ‘normal’ samples of size n 


Table 1 (cont.). Probability integral of the extreme deviate (x,,—Z)/o or ({—2,)/o 










































































































— 3 4 5 6 7 8 9 
u 
10-* 10-* 10-* 10-* 10-* 10-* 10-4 
4-50 999 999 999 999 999 998 999 996 999 994 999 992 
4-51 999 999 999 999 999 998 999 997 999 994 999 992 
4-52 999 999 999 999 999 998 999 997 999 994 999 992 
4-53 999 999 999 999 999 998 999 997 999 995 999 993 
4-54 999 999 999 999 999 998 999 997 999 995 999 993 
4-55 1-000 000 999 999 999 998 999 997 999 995 999 993 
4-56 999 999 999 998 999 997 999 996 999 994 
4-57 999 999 999 998 999 998 999 996 999 994 
4-58 999 999 999 998 999 998 999 996 999 994 
4-59 999 999 999 998 999 998 999 996 999 995 
4-60 1-000 000 999 999 999 998 999 996 999 995 
4-61 999 999 999 998 999 996 999 995 
4-62 999 999 999 998 999 997 999 995 
4-63 999 999 999 998 999 997 999 995 
4-64 999 999 999 998 999 997 999 996 
4-65 999 999 999 999 999 997 999 996 
4-66 } | 999 999 999 999 999 997 999 996 
4-67 | 999 999 999 999 999 997 999 996 
4-68 999 999 999 999 999 998 999 997 
4-69 999 999 999 999 999 998 999 997 
4-70 999 999 999 999 999 998 999 997 
Table 2. Percentage points of the extreme deviaie (x,,—%)/o or (E—x,)/o 
Size Lower percentage points Upper percentage points 

SG. | 

sample | ] 
n 0-1 0-5 1-0 2-5 5-0 10-0 | 10-0 5-0 | 2-5 1-0 0-5 0-1 
3 0-03 | 0-06 | 0-09 | 0-14 | 0-20 | 0-29 1-50 1-74 | 1-95 | 2-22 | 2-40 | 2-78 
4 0-09 | 0-16 | 0-20 | 0-27 0-35 | 0-45 | 1-70 1-94 | 2-16 | 2-43 | 2-62 | 3-01 
5 0-16 | 0-25 | 0-30 | 0-38 | 0-47 | 0-58 | 1-83 | 2-08 | 2-30 | 2-57 2-76 | 3:17 
6 0-23 | 0-33 | 0-38 | 0-48 | 0-56 | 0-68 1-94 | 2:18 | 2-41 2-68 | 2°87 | 3-28 
7 0-30 | 0-40 | 0-46 | 0-56 | 0-65 | 0-76 | 2-02 | 2-27 | 2-49 | 2:76 | 2-95 | 3-36 
8 0-36 | 0-47 | 0-53 | 0-62 | 0-72 | 0-84 | 2-09 | 2:33 | 2-56 | 2-83 | 3-02 | 3-43 
9 0-41 0-53 | 0-59 | 0-69 | 0-78 | 0-90 | 2:15 | 2-39 | 2-61 2-88 | 3-07 3-48 
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Table 6A. Lower per cent points of the studentized extreme deviate (x,,—Z)/s, or (Z—2,)/s, 





n 5% 1% 











15 | 0-20 | 0°35 | 0-46 | 0-55 | 0-63 | 0-70 | 0-75 | 0-09 | 0-19 | 0-29 | 0-37 | 0-44 | 0-50 | 0-56 
30 | 0-20 | 0°35 | 0-46 | 0-56 | 0-64 | 0°70 | 0-77 | 0-09 | 0-20 | 0-29 | 0-38 | 0-45 | 0-51 | 0-57 





















































B. Upper per cent points of the studentized extreme deviate (x,,—Z)/s, or (—2,)/s, 


















































n 5% 1% 
| | | 
v\| 3 | 41] 5 6 7 8 9 3 4 5 Sxl) # 8 9 
\| | 
10 | 2-02 | 2-29 | 2-49 | 2-63 | 2-75 | 2-85 | 2-93 | 2-76 | 3-05 | 3-25 | 3-39 | 3-50 | 3-59 | 3-67 
11 | 1-99 | 2-26 | 2-44 | 2-58 | 2-70 | 2-79 | 2-87 | 2-71 | 3-00 | 3-19 | 3-33 | 3-44 | 3-53 | 3-61 
12 | 1-97 | 2-22 | 2-40 | 2-54 | 2-65 | 2-75 | 2-83 | 2-67 | 2-95 | 3-14 | 3-28 | 3-39 | 3-48 | 3-55 
13 | 1-95 | 2-20 | 2-38 | 2-51 | 2-62 | 2-71 | 2-79 | 2-63 | 2-91 | 3-10 | 3-24 | 3-34 | 3-43 | 3-51 
14 | 1-93 | 2-18 | 2-35 | 2-48 | 2-59 | 2-68 | 2-76 | 2-60 | 2-87 | 3-06 | 3-20 | 3-30 | 3-39 | 3-47 
| 
15 | 1-92 | 2-16 | 2°33 | 2-46 | 2-56 | 2-65 | 2-73 | 2-57 | 2-84 | 3-02 | 3-16 | 3-27 | 3-35 | 3-43 
| 16 | 1-90 | 2-14 | 2-31 | 2-44 | 2-54 | 2-63 | 2-70 | 2-55 | 2-81 | 3-00 | 3-13 | 3-24 | 3-32 | 3-39 
| 17 | 1-89 | 2-13 | 2-30 | 2-42 | 2-52 | 2-61 | 2-68 | 2-52 | 2-79 | 2-97 | 3-10 | 3-21 | 3-29 | 3-36 
18 | 1-88 | 2-12 | 2-28 | 2-41 | 2-51 | 2-59 | 2-66 | 2-50 | 2-77 | 2-95 | 3-08 | 3-18 | 3-27 | 3-34 
19 | 1-87 | 2-11 | 2-27 | 2-39 | 2-49 | 2-58 | 2-65 | 2-49 | 2-75 | 2-92 | 3-06 | 3-16 | 3-24 | 3-31 
| 
20 | 1-87 | 2:10 | 2-26 | 2-38 | 2-48 | 2-56 | 2-63 | 2-47 | 2-73 | 2-91 | 3-04 | 3-14 | 3-22 | 3-29 
| 24 | 1-84 | 2-07 | 2-23 | 2:35 | 2-44 | 2-52 | 2-59 | 2-43 | 2-68 | 2-85 | 2-97 | 3-07 | 3-15 | 3-22 
| 30 | 1-82 | 2-04 | 2-20 | 2-31 | 2-40 | 2-48 | 2-55 | 2-38 | 2-62 | 2-79 | 2-91 | 3-01 | 3-08 | 3-15 
| 40 | 1-80 | 2-02 | 2-17 | 2-28 | 2-37 | 2-44 | 2-51 | 2-34 2-57 | 2-73 | 2-85 | 2-94 | 3-02 | 3-08 
| : 
| 60 | 1-78 | 1-99 | 2-14 | 2-25 | 2-33 | 2-41 | 2-47 | 2-30 | 2-52 | 2-68 | 2-79 | 2-88 | 2-95 | 3-01 
1120 | 1-76 | 1-97 | 211 | 2-21 | 2-30 | 2-37 | 2-43 | 2-25 | 2-48 | 2-62 | 2-73 | 2-82 | 2-89 | 2-95 | 
| co | 1-74 | 14 | 2-08 | 2-18 | 2-27 | 2-33 | 2-39 aad ex 2-57 | 2-68 | 2-76 | 2-83 | 2-88 
| | | | 
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THE FISHER-YATES TEST OF SIGNIFICANCE IN 
2x2 CONTINGENCY TABLES 


By D. J. FINNEY 
Lecturer in the Design and Analysis of Scientific Experiment, University of Oxford 


1. INTRODUCTION 


One of the tests of significance most frequently required in applications of statistics to 
biological problems is that for the 2 x 2 contingency table. Briefly, the problem may be 
typified by the following statement: Given two series of observations, with individual 
results assumed independent of one another and classified as either ‘success’ or ‘failure’, 
do the proportions of successes observed in the two series differ more widely than might 
reasonably be expected if the population values of these proportions are equal? If the 
expected numbers of successes and failures, calculated from the null hypothesis, are all 
moderately large, a simple and well-known form of x? test may be used; this test gives a good 
approximation to the true probability of a deviation from equality as great as that observed, 
especially if the adjustment usually termed ‘Yates’s correction’ is applied (Yates, 1934; 
Fisher, 1946, §§ 21, 21-01). 

Not infrequently, however, the expected numbers are too small for the x? test to be trusted. 
Fisher has recommended that, if any one of the expectations is less than 5, special steps 
should be taken; Aitken (1944) and Cramér (1946) suggest a minimum of 10. Investigations 
by Cochran (1942) indicate that no simple rule of this kind-is completely adequate, and that 
the magnitudes of all four expectations affect the quality of the approximation. Yates (1934) 
and Fisher (1946, § 21-02) have given an exact method for the evaluation of the required 
probability, for use when small frequencies make any x? approximation unreliable, Their 
method uses the four marginal totals as ancillary statistics: that is to say, the probability 
is obtained as a relative frequency amongst all configurations having the same marginal 
totals. More recent writers, notably Barnard (1947) and Pearson (1947), have questioned 
whether this assumption of fixed marginal totals is logically justifiable for all 2 x 2 contin- 
gency tables; Barnard has discussed the specifications of several distinct problems, and 
maintains that the Fisher-Yates test is applicable to only one of these. Nevertheless, the 
test is undoubtedly the right one for at least one important class of problem, and for this 
may be described as an exact method.f 

The Fisher-Yates method requires rather tedious calculations, though the labour can be 
much reduced by use of a simple table of the logarithm of the factorial function, such as that 
given by Fisher & Yates (1948, Table X XX). The purpose of the present paper is to present 
a table of significance levels for their exact test which is applicable when all the frequencies 
are small. Yates (1934) and Fisher & Yates (1948, Table VIII) give a concise table which, 
with the aid of a small amount of calculation, leads to a good approximation to the exact 
probability; the new table provides tests of significance only, but has the advantage of 
direct entry instead of preliminary calculation. Rules for the use of the table are given in 


§ 2, in sufficient detail for the non-mathematical reader; a brief account of the method of 
construction follows in §3. 


+ The probability associated with any of the classes of problem distinguished by Barnard is satisfactorily 
approximated by that obtained from x? when all expected frequencies are large. 
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2. THE TABLE OF SIGNIFICANCE LEVELS AND ITS USE 
The table which follows may be used to test the significance of the deviation from pro- 
portionality in any 2 x 2 contingency table having both frequencies in one of its margins less 
than or equal to 15. The contingency table must first be put in the form 














Number of 
Number of 
observations 
Successes Failures 
Series I a A-a A 
Series IT b B-b B 
Total a+b A+B-a-b A+B 




















where Series I is defined to be that which makes A > B, and the type of observation con- 
ventionally regarded as a ‘success’ is that which makes a/A >6/B. For small integers, the 
right arrangement can usually be made on sight, especially if the second condition is used 
in the form aB>bA. 


Providing that A < 15, the table at the end of this section may then be entered in the section 
for A, the sub-section for B, and the line for a. If 6 is equal to or less than the integer in 
the column headed 0-05 or 0-01, a/A is significantly greater than b/B (single-tail test) at the 
probability level 0-05 or 0-01 respectively. If 6 is equal to or less than the integer in the 
column headed 0-025 or 0-005, a/A is significantly different from b/B (two-tail test) at the 
probability level 0-05 or 0-01 respectively. A dash, or absence of any entry, for some 
combination of A, B, and a indicates that no contingency table in that class is significant. 
The probability corresponding to b will generally be less than that shown at the head of 
the column, and the true numerical values are shown in small type. Those in the 0-025 and 
0-005 columns should be doubled if used in a two-tail test. 

From the mathematical point of view, the two pairs of marginal totals play equivalent 
roles in the test. Consequently, if only one set satisfies the condition that neither total exceeds 
15, that margin may be conventionally regarded as relating to the two series, and the other 
classification must then be taken as ‘success’ and ‘failure’ (see example below). If both 
margins satisfy the condition, the two possible arrangements will iead to identical 
conclusions. 

The use of the table presented here may be extended by noting that any contingency 
table more extreme than one known to show significant deviation from proportionality 
must itself be non-significant. Thus, even though one of each pair of marginal totals exceeds 
15, a test of significance without calculation may still be possible. In particular, if the 
standard arrangement of the contingency table gives 


a A-a | A 
b B-b | B 
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with A > 15> B and aB>DA, the deviation from proportionality will be significant if 





15+a-—A A-a 15 
b B-b | B 
15+a+b-—A A+B-a-b | 15+B 


is significant (but not necessarily non-significant otherwise), and the deviation will be 
non-significant if 





a 15-—a 15 
b B-b B 
a+b 15+ B-—a—b | 15+B 


is not significant (but not necessarily significant otherwise). 

As an example of the use of the table, Lange’s data on criminality among twin brothers or 
sisters of criminals (Fisher, 1946, § 21-01) may be examined. The contingency table below 
shows the numbers of twin brothers or sisters of criminals who had also been convicted, 
separately for monzygotic and dizygotic (but like-sexed) twins. 











Not convicted Convicted Total 
Dizygotic 15 2 17 
Monozygotic 3 10 13 
Total 18 12 30 




















Since 15/17>3/13 the category ‘not convicted’ is regarded as success. Consider the 
contingency table 





13 2 15 
3 10 13 
16 12 | 28 


in which A = 15, B = 13, anda = 13. The null hypothesis is that, in the general population, 
freedom from conviction is equally frequent amongst dizygotic and monozygotic sibs. If 
the only deviation from the null hypothesis which the investigator is prepared to consider 
is that monozygotic twins behave more similarly than dizygotic, he will require a one-tail 
significance test. The table below shows 4 as the 0-01 significance level of 6b (with a true 
probability of 0-004, not 0-010). Hence 6 = 3 is significant: by the rule given, the deviation 
from proportionality in the original table is significant evidence that criminality is more 
frequent among monozygotic twins of criminals than among dizygotic twins of criminals. 
Fisher gives the exact probability for the origina] data as 1/2150. On the other hand, if the 
investigator were concerned only to demonstrate a significant difference between the 
frequencies of freedom from conviction for the two types of twin, irrespective of whether 
monozygotic or dizygotic should show the higher value, he would use a two-tail test; for 


10-2 





148 The Fisher- Yates test of significance in 2 x 2 contingency tables 


A = 15, B = 13, a = 13, the value of 6 in the 0-005 column is again 4 (though generally it 
will be less than for the one-tail test), and again the evidence against the null hypothesis is 
judged significant, both for the modified and for the original contingency table. 

As an illustration of the interchangeability of marginal totals, the same data may be 
examined by arranging the contingency table as: 











Dizygotic Monozygotic Total 
Convicted 15 3 18 
Not convicted 2 10 12 
Total 17 13 30 























in which ‘dizygotic’ is classed as success. Logically the meaning may be different, but the 
test of significance is the same. The modified contingency table 








12 3 15 
2 10 12 
14 13 | 27 


has A = 15, B= 12, a = 12; b = 2 is judged significant by comparison with the tabular 
values 3 at 0-01 or 2 at 0-005, and therefore again significance is attained on either the one-tail 
or the two-tail test. 


The table follows on pp. 149-54. 


*3. CONSTRUCTION OF THE TABLE 
Any 2x 2 contingency table to which a test of significance is to be applied must first be 
written in the standard form shown at the beginning of § 2, in which the event regarded as 
a success and the arrangement of the rows are so chosen that A>B and a/A>6/B. If 
a/A = b/B, there is no need to proceed further, as the data then accord perfectly with the 
null hypothesis; if a/A > 6/B, of necessity a >b. On the null hypothesis that the population 
values for the proportions cf successes are equal, and for the specified set of marginal totals, 
the probability of this set of frequencies is (Fisher, 1946, § 21-02): 
P, = P(b| A, B,a+b) 
A! B!(a+6)!(A+ B-—a-—b)! 1 
Ere rs | *alb\(A—a)!(B—b)! 
The first factor in this expression is dependent only on the marginal totals, the second 
depends upon the internal cell frequencies. The probability that a deviation from equality 
of the two proportions as great as or greater than that observed should occur by chance is 
then P*, where P} = P*(b| A, B,a+b) 
= Bt RatRat--+Pp 

and k is the greater of the two quantities 0 and (a+6—.4). In the summation the four 
marginal totals are kept fixed. Barnard (1947) has discussed the logic of the test in detail. 
He distinguishes certain classes of problem for which, in his view, the method described here 


is inappropriate; this topic has been a source of some controversy, to which the present 
paper is not intended as a contribution. 











Table of significance levels of b 
























































erally it (Values of 5 in bold type; corresponding probabilities, P;, in small type) : 
thesis is fia 
Probability Probability 
may be @ a 
0-05 0-025 0-01 0-005 0-05 0-025 0-01 0-005 
A=3 B=3| 3 0 050 | — “—* — A=8 B=8| 8 4 -038 3 -013 2 -003 2 -003 
Fj 2 -020 2 -020 1 -00s+ | O -001 
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3| 4 0 02 | — oa. ae + 0 038 | — = et 
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6 | 1 015-| 1 -015-| 0 02 | O -002 4/ 0 04 S de 
5 0 -o10+ 0 -o10+ | — @ as 
} 4 oO <@as- | — J se: 8| 9 4 -029 3 -009 3 -009 2 -002 
8 3 -043 2 -013 1 -003 1 -003 
6| 7 F .005- .005- 
6 : rool : be . pes ; ps 7 2 -044 1 -012 0 -002 O -002 
5 0 -016 0 016 6 1 -036 0 -007 0 007 | — 
second | 1 @ée 1. i = 5 | 002 | 0 00 | — aa 
quality 5| 7 | 2048+] 1 -o10+ | 0 001 © 201 7; 9 | 3 -o19 3 -019 2 -oos- | 2 -dos- 
lance is 6 | 1 -04s+ | © -008 0 oo | — - 8 | 2 02 2 024 1 -006 0 001 
A 5 | 0-027 | — aii 4 7 1 -020 1 -020 0 -003 0 -003 
6 0 -o10+ | O -o10+ | — = 
4) 7 1 024 1 -024 0 -003 003 Ss) Sam 1 ~_ = 
6 0 -o1s+ | © -o1s+ | — ne 
he four 5 | O -os+ | — >) B 6| 9 | 3 -04 2 -o1 1 coz | 1 -002 
: , 8 | 2 -047 1 011 0 -001 0 -001 
detail. 3 ; . 008 0, -008 0 oo | — 7 | 1 -035- | © -006 0 06 | — 
ed here ae da gi} w& 6 | 0 017 0 017 | — = 
present 2} 7 | 0 02 | — — _ 5 | O02 | — = ites 












































Table of significance levels of b (continued) 










































































| Probability Probability 
a a : 
0-05 | 0-025 | 0-01 | 0-005 0-05 | 0-025 : 0-01 | 0-005 
= ——+ 
A=9 B=5 i) 2 027 1 .ovs- 1 -00s—| 1 v05-| A=10 B=4] 10 1 -o11 i -011 0 -001 0 oi 
S 1 023 1 -023 003 0 -v03 g 1 v4! 0 -00s-| 0 -005-}| O -oor 
7 Q -o10* | O -o1r0+ | — z°8 8 G -o1s-| O -o1s—}| — a 
6 0 oz | — dite i - 7 0 -035s- | — — — 
4 9 1 -014 1 -014 0 -00 0 -001 3} 10 1 -038 0 -003 0 -003 0 -003 
8 0 -007 0 -007 0 -007 | — 9 0 -014 0 014 | — ae 
7 0 -021 0 -021 — — 8 0 -03s- | — — — 
éb*et le i aad 2| 10 | © -o1s+| © ors: | — a 
3 9 1 045+] QO -005- | O -005 0 -00s- 9 0 045+ | — _ —_ 
8 0 018 0 om | — we 
7 | O -vast} — = a - A ce 
2? 9 0 -v18 0 ow | — —_ A=11-B=It] 7 045" | 6 -018 5 -006 4 00 
10 § -032 4 012 3 -004 3 -004 
9 4 -040 3 -015 2 -004 2 -004 
A=!0 B=10) 10 6 043 5 -016 4 -005' 3 -002 8 3 -043 2 -015 1 -004 1-005 
cS) 4 029 3 010 3 -o10 2 -003 7 2 -040 1 012 0 -002 0 
8 3 035 2 012 1 -003 1 -003 6 1 -032 0 -006 0 006 | — 
7 2 035- | 1 -o10 1 -010 0 -002 5 O -018 0 -o18 | — — 
6 | 1 029 | 0 -oos+| © -oos+ | — 4 | 0 04s: | — = = 
5 0 -016 0 016 | — saa 10} 11 6 035" | § -012 4 -004 4 -004 | 
4 0 043 | — is ie 10 4 021 4 021 3 -007 2 -002 
9} 10 | 5 033 | 4 -o1n 3 -003 3 003 9 | 3 -o24 3 024 | 2 -007 1 00 
9 4 050 3-017 2 005 2 -0vs 8 2 -023 2 -023 1 -006 0 -v01 
8 2 019 2 01 1 -004 1 -004 7 1 017 1 017 0 -003 0 wi 
7 1 01s 1 -015 0 -002 0 -002 6 1 -043 : 0 -os 0 oo | — 
6 1 -040 0 -008 0 -oos | — 5 0 .023 0 023 |— — 
5 0 022 Oo on |. 9g] 11 5 026 | 4 -v08 4 -008 3 -w2 
&| 10 4 023 4 023 3 -007 2 002 10 4 -038 | 3 012 2 -003 2 wi 
9 3 -032 2 -009 2 v9 1 -002 9 3 040 | 2 012 1 -v03 1 003 
8 2 0% 1-008 1 -vvz 0 -ov1 8 2 035 | 1 -ouy 1 ov 0 001 
7 1 -023 1 -023 0 -v04 0 -004 7 1 02s | 1 -02s5 0 -004 0 -v04 
6 0 vil Je ae ee ane 6 0 -012 S o12. f..— — 
5 0 -029 sa ae 5 0 -ow aa rin 
7\ 10 | 3 -o1s 3 -o15 2 003 2 003 8} 11 4 oi | 4 018 3 00s 3 -0s 
y 2 v18 2 -018 1 -004 1-004 10 3 024 3 -024 2 006 1-00! 
8 1 -013 1 -013 0 002 | 0 -002 | 9g 2 022 a 2 022 1 -00s 1-005 
7 1 -036 0 .0v6 0 006 a 8 1 ois | 1 -o1s | Q -002 | 0 -002 
6 0 017 0 017 |- 7 | 1 037 0 -007 0 -007 i_— 
5 | 0 041 he 7 6 | Oo7 | 0 o7 | | — 
6; 10 | 3 036 | 2 -008 | 2 -008 1 -001 5 | 0 o40 ies ins ‘<a 
| 9 | 2 -036 | 1 -00% 1 008 | O vol 7} 11 | 4-043 | 3 -on | 2 -002 2 -om 
| 8 1 024 1 -024 | O 003 | O -003 | 10 3 -047 2 013 | 1 002 1 -002 
| 7 | O -o1o+ | 0 -o10 = if. 9 | 2 -039 1 009 | 1 -009 0 001 
6 | O 026 | = sie 8 | 1 o2s-| 1 -02s | O 004 | O co 
5 10 | 2 -022 2 -022 1 -004 1 004 7 Q 10 0 o10 ae = 
9 | 1-017 1 -017 0 -002 002 | 6 G 02s | O 02s te ." 
| 8 | 1 -047 0 -007 | 0 07 | — 6| 11 3 029 | 2 006 | 2 -006 1-001 
7 | O09 | O-ow | — ok | 10 | 2-028 | 4 -oos+| 1 -oos+| © 01 
6 | 0 -042 | — | — ie 9 1 -018 1 -018 0 -002 0 002 
| = | | | a = 























Table of significance levels of b (continued) 












































| 
Probability Probability 

a a a 

| | 0-005 0-05 | 0025 | 001 | 0-005 0-05 | 0025 | 001 | 0-005 

y -001 A=11 B=6| 8 1 -043 0 -007 0 -007 A=12 B=9| 7 1 -037 0 -007 0 -007 | — 

s~ | O cr 710017 | 0 a7 |— =k 6°'| 0 017 | O o17 | — ee 
bis 5 6 0 037 | — = — 5 0 039 | — < — 
pe 5} 11 | 2 -o18 | 2 018 | 1 003 | 1 -003 8| 12 | 5 009 | 4-014 | 3 004 | 3 -004 

3 0 003 10 1 -013 1 -013 0 -001 0 -001 11 3 -018 3 -018 2 -004 2 -004 
= : 9 1 -036 0 -005-| O -005-| O -o0s- 10 | 2 -o1s+| 2 -o1s+] 1 -003 1 -003 
ee 8 0 -013 S47 —s 9 2 -040 1 -o10-| 1 -10-| O -001 
ae 7 1 ae a = = 8 | 1 -025-| 1 -025-| O -004 | O -004 
ves 4} 11 | 1-009 | 1-009 | 1-009 | © -oo1 7 | © 010+} O -o10* | — a4 

ie Gees 10 | 1 033 | O -004 | © 004 | O -004 6 | 0 02 | O or | — tee 

9 0 -011 » 1 | _— 7| 12 4 -036 3 -009 3 -009 2 -002 

6 4 -00 8 0 026 | — — Sos 11 3 -038 2 -010-| 2 -010-|] 1 -002 

4 | 3 oj 3] 11 | 1-033 | © 003 | © -003 | © -003 10 | 2 029 | 1 006 | 1 -006 | O -o01 

4 | 2 -005 10 | O -o1 0 -o1 | — — 9 | 1 017 ; 017 ~ 002 | O -002 

4 1-004 é 8 1 -040 -007 007. | — 

2 0 - ‘ - deed 7 0 -016 0 016 | — — 

= i ~ “4 ; pi 0 013 | — ‘tag 6 0 034 | — — ee 
a. 6| 12 3 -025-| 3 -025s-| 2 -oos—-| 2 -oos- 
a ss ll 2 -022 2 -022 1 -004 1 -004 

eS ty laqi2 B=12] 12 | 8 0@ | 70 | 6 0 | 5 o02 >| ia | eerle oer ee 

‘. 1 al 11 6 -034 5 -014 4 -00s- | 4 -005- 8 0 -— “Gen pie oe 

. 0 a 10 5 04s-| 4 -018 3 -006 2 -002 7] @es-| 61. = 

. ea 9 | 4 050-| 3 -020 2 -006 1 -001 6 0 pre eae Se See 

<5 pe 8 | 3 0so-| 2 018 | 1 -o0s-| 1 -oos- 

7 2 -04s-| 1 -014 0 -002 0 -002 31 ie 2 -o1s- | 2 o1s-| 1 -002 1 -002 
- ' 6 1 -034 Q -007 0 -007 2g ll 1 -010- 1 -010- 1 -010- 0 -001 

8 3 -w2 5 0 -019 Sa Fu 10 1 -028 0 -003 0 -003 0 -003 

3 2 -003 al @en ft =e == 9 | 0 -009 | O -009 | O -o09 | — 

i ; al If] 12 | 7 037 | 6 014 | § -o0s-| 5 -0os- ? ; bn be = a or 

i oa 11 5 -024 5 -024 4 -008 3 -002 

10 4 -029 3 -o10+ 2 -003 2 -003 4 12 2 -050 1 -007 1 -007 0 -001 
q- } 9 3 -030 2 -009 2 -009 1 -002 11 1 -027 0 -003 0 -003 0 -003 
fin: 8 | 2 -026 1 -007 1 007 | O -001 10 | 0 008 | O -o08 | O -oog | — 

5 3 -00s 7 1 -019 1 -019 0 -003 0 -003 9 0 -019 0 -019 —_ — 

6 1-001 | 6 1 -04s-| 0 -009 0 -00 | — 8 x ee — — 

is | 1 vos? 5 | 0 024 | O om | — _ 3/ 12 | 1-029 | © -c02 | © -co2 | O -o02 

2 | 0 om 10| 12 | 6 029 | § -o10-| 5 -o10-| 4 -003 11 | © 009 | © 009 | O co | — 

ft ez 11 5 043 | 4 015+] 3 -o0s-| 3 -00s- 10 | © 022 | O 022 | — = 
i 2 10 | 4 048 | 3 017 | 2 -oos-| 2 -oos- 9 | Om |— = = 
a 9 3 -046 2 -015- | 1 -004 1 -004 2! 12 0 -o11 © au [— — 

)2 2 -on2 8 2 -038 1 -010+ | O -002 0 -002 11 0 -033 | — _ — 

2 1-002 \ | 7 1 -026 0 -oos- | 0 -00s- | O -00s- | 

9 0 -001 | | 6 0 -012 So 2 | — — 

* | es Sistas dS ten _ = A=13 B=13| 13 | 9 0 | 8 020 | 7 007 | 6 0 
he 9} 12 5 -021 5 -021 4 -006 3 -002 12 7 -037 6 -01s+ | 5 -006 4 -002 
i—- a 11 | 4-029 | 3 009 | 3 009 | 2 -002 li | 6-048 | 5 021 | 4 008 | 3 -o02 

% | 1 oo} | 10 3 -029 2 -008 2 -008 1 -002 10 | 4 -024 4 -024 3 -008 2 -002 

s+ | O on | | 9 2 -024 2 -024 1 -006 0 -001 9 3 -024 3 -024 2 -008 1 -002 

2 | O on} | 8 | 1-016 | 1-016 | © -002 | O -002 | 8 | 2 om | 2 o2 1 006 | O -001 
| tS a ae Re ce Fe 









































Table of significance levels of b (continued) 







































































Probability Probability 
a @ \' 
0-05 0-025 0-01 0-005 0-05 0-025 0-01 0-005 
A=13 B=13 7 2 -048 1 -01s+ | Q -003 0 003 | A=13 B=7} 11 2 -022 2 -022 1 -004 1 004 | |A= 
6 1 -037 0 -007 0 007 | — 10 1 -012 1 -012 0 -002 0 -om 
= 0 -020 0 020 | — — 9 1 -029 0 -004 0 -004 @ -004 | 5 
4 0 -o48 | — ate a 8 0 010+ | O -o10* | — — 
12| 13 | 8 039 | 7 -o1s-| 6 -oost+| 5 -002 7 | © 022 | O 2 | — a 
12 6 -027 5 -010-| 5 -010-| 4 -003 6 0 044 | — eo. sit |) 
11 5 -033 4 -013 3 -004 3 -004 6| 13 3 -021 3 -021 2 -004 2 -004 | 
10 4 036 3 -013 2 -004 2 -004 12 2 -017 2 017 1 -003 1 -003 | | 
9 | 3 034 | 2 -o11 1 -003 | 1 -003 11 | 2 046 | 1 -010-| 1 -010-| Q -001 | 
8 | 2 -029 1 -008 1 -008 | O -001 10 | 1 024 | 1 -024 | © -003 | © -o3 |} 
7 | 1 020 | 1 020 | © -004 | © -004 9 | 1 -050-] 0 008 | O cos | — 
6 1 -046 0 010-| O -o10-; — 8 0 -017 0 017 | — ies 
5 | @ 024 | © 024 | — _ 7 | 0 03% | — = — 
11} 13 7 031 6 -011 5 -003 5 -003 31 Bo 2 -012 2 -012 1 -002 1 -002 
12 | 6 -048 5 018 4 -006 3 -002 12 | 2 -0«4 1 -008 1 -008 O -001 | 
11 4 -021 4 021 3 -007 2 -002 11 1 -022 1 -022 | O -002 | O -om 
10 3 -021 3 -021 2 -006 1 -001 10 1 -047 | °O -007 0 -007 | — |? 
9 | 3 050-| 2 017 | 1 004 | 1 -004 9 | O 01s-| O -o1s- | — — |i 
8 2 -040 1 -o11 0 -002 0 -002 8 0 029 | — _— sai } 
7 1 -027 0 -005-| 0 -005-| O -o0s- 4| 13 2 -044 1 -006 1 -006 0 -00 | | 
6 0 -013 0 013 | — _ 12 1 -022 1 -022 0 -002 0 -002 | 
5 0 -030 _— — — 11 0 -006 0 -006 0 -006 = 
10} 13 6 -024 6 -024 5 -007 4 -002 10 0 -015-| O -o1s- | — ann 
12 5 035-| 4 012 3 -003 3 -003 9 0 02 | — _— — | 
Il | 4 037 | 3 012 | 2 003 | 2 -003 3] 13 | 1-025 | 1 025 | © 002 | © -om2|| 
10 3 -033 2 010+ | 1 -002 1 -002 12 | O -007 0 -007 0 007 | — | 
9 | 2 026 | 1 006 | 1 006 | 0 -001 11 | 0 o18 | O 18 | — a 
8 | 1 -017 1 017 | O -003 | O -003 10 | 0-036 | — — a 
7 1 -038 0 -007 0 007 | — 
6 0 -017 0 017 | — eX 2) 13 0 -010-| O 010-| O -o10- — 
5 0 038 | — — i 12 0 029 | — — —_ 
9} 13 | 5 017 | § 017 | 4 -oos-| 4 -00s- j 
ee | oe | Sr | 2 Inia pats] 14 |10 20 | 9 20 |.8 on | 700 
11 3 -022 3 022 | 2 -006 1 -001 13 | 8-038 | 7 016 | 6 006 | 5 -o 
10 2 -017 2 -017 1 -004 1 -004 12 6 -023 6 -023 5 -009 4 -003 
9 | 2 -040 1 -010+ | 0 -001 0 -001 il 5 027 | 4 011 3 -0c4 | 3 rag |? 
8 | 1 025-| 1 -025-| “0 004 | O 004 10 | 4 028 | 3-011 | 2 003 | 2 003 | 
7 | © 010+) © -o10+ | — — 9 | 3 027 | 2-009 | 2 -009 | 1 -on2 | 
6 | 0 023 | O 023 | — — 8 | 2 023 | 2 -023 1 -006 | O -001 
5 | 0 0% | — ag — 7 | 1-016 | 1-016 | © -003 | © -003 
8| 13 5 042 |, 4 -012 3 -003 3 -003 6 1 -038 0 -008 0 -o08 | — 
12 4 -047 3 -014 2 -003 2 -003 5 0 -020 | 0 020 | — — 
11 3 -041 2 -011 1 -002 1 -002 4 0 -049 | — — — , 
10 2 -029 1 -007 1 -007 0 -001 13 14 9 -041 8 -016 7 -006 6 -002 
9 | 1 017 1 017 | 0 -002 | O -002 13. | 7-02 | 6 -o1 5 004 | § -004 
8 | 1037 | 0 006 | 0 006 | — 12 | 6 037 | 5 -o1s+| 4 -o0s+| 3 on | | 
7 | 0 015-| O -o1s- | — — 11 | 5 04 | 4-017 | 3 006 | 2 -001 
6 | 0 032 | — ne aad 10 | 4-04 | 3 016 | 2 -oos-| 2 -cos- 
7| 13 4 -031 3 -007 3 -007 2 -001 9 3 -038 2 -013 1 -003 1 -003 | | 
12 3 -031 2 -007 2 -007 1 -001 8 2 -031 1 -009 1 -009 0 -001 | > 








Table of significance levels of b (continued) 




































































Probability Probability 
cee a a 
0-005 0-05 0-025 0-01 0-005 0-05 0-025 0-01 0-005 
1 -004 =14 B=13| 7 1 -021 1 -021 004 | 0 004 | A=14 B=7]| 14 | 4 -026 3 -006 3 -006 | 2 -001 
0 -002 | | | 6 1 -048 0 -o10+ | — — 13 3 -025 2 -006 2 -006 1 -001 
CQ -004 | 5 0 -025-| O -o2s- | — = 12 2 017 2 -017 1 -003 1 -003 
= 12) 14 | 8 033 | 7 012 | 6 -004 | 6 -004 11 | 2 -041 1 -009 | 1 009 | O -001 
— | 13 | 6 021 | 6 021 | 5 007 | 4 02 10 | 1 021 | 1 021) 0-003 | O 003 
— | 12 5 -025+ 4 -009 4 -009 3 -003 9 1 -043 0 -007 0 .-007 a 
2 -004 | 11 | 4-026 | 3-009 | 3 009 | 2 -002 8 | O 015-!) O -o15~ | — — 
1 03 | | 10 | 3 024 | 3 024 | 2-007 | 1 -002 7 | 0 030 |— = = 
0 -001 | 9 | 2-019 | 2-019 | 1 -oos-| 1 -ous- 6| 14 | 3 018 | 3 018 | 2 003 | 2 -003 
O -003 | } 8 | 2 042 | 1-012 | O -002 | O -002 13 | 2-014 | 2-014 | 1 -o02 | 1 -002 
a 7 1 -028 0 -005+ | O -o0s+ | — 12 2 -037 1 -007 1 -007 0 -001 
ee | 6 | 0 -013 0 013 | — — 11 1- -018 1 018 | 0 -coz | O -002 
eo. 5 i, @: me |x —_ — 10 1 -038 | O -o0s+| O -o0s+ | — 
1-002 | 11] 14 | 7 -026 | 6 -009 | 6 -009 | 5 -003 9 | 0 012 | O 012 | — — 
0 -001 | 13 6 -039 5 -014 4 -004 4 -004 8 | O -024 0 024 | — — 
0 072 12 5 -043 4 -016 3 -005- | 3 -00s- 7 | 0 04 | — _ os 
ae || il 4 -042 3 -01s- | 2 -004 2 -004 5| 14 | 2 10+] 2 010+] 1 -o01 1 -001 
ae, 1f | 10 3 -036 2 -011 1 -003 1 -003 13 2 -037 1 -006 1 -006 0 -001 
a. | 9 | 2027 | 1-007 | 1 007 | O -001 12 | 1-017 | 1-017 | © 2 | O 002 
0 | 8 | 1-017 | 1-017 | O 003 | O -003 il 1 038 | © -cos—| © -cos-| © -oos- 
oT 7 | 1-038 | 0 007 | 0 -oo7 | — 10 | Oon | O-on | — me 
0 -002 6 0 -017 0 -017 —_ — 9 0 -022 0a | — —_ 
a 5 | 0 038 | — — ~~ 8 | 0 -o4 | — = = 
10} 14 6 -020 6 -020 5 -006 4 -002 = os pee ee 
sail 13 | Son | 40m | 4 a | 3 am Pakedbeg, he 
=e | ot I gpenn ipo i 2m 12 1 -044 0 -o0s-| 0 -o0s-| O -005- 
| 11 3 924 3 -024 2 -007 1 -001 il 0 -o11 0 on | — PS: 
aie | 10 | 2 018 | 2 -o18 1 -004 | 1 -004 10 | 0 023 | 0 023 | — ce 
= || 9 | 2 -040 1 -011 0 -002 | O -002 9 | 0 -o1 | — 2 = 
8 1 -024 1 -024 | O -004 | O -004 
7 | 0 010-| O -o10-| O -o10- | — 3} 14 | 1 022 | 1 022 | O oor | O -001 
6 | O -022 0 022 | — 13 | O -006 | O -006 | O 006 | — 
b 5 | 0 047 | — ies Az 12 | 0 -o1s-! © -o1s- | — Ss 
7 -003 9| 14 | 6 067 | 5 014 | 4 004 | 4 -004 owe T— = yp 
' 5 -002 13 | 4-018 | 4-018 | 3 -oos-| 3 -o0s- 2) 14 | © -c08 | O 008 | O -oo8 | — 
4 -003 12 | 3 017 | 3 017 | 2 04 | 2 -004 13 | 0 025 | O ozs | — = 
3 004 | { 11 | 3 042 | 2 012 | 1 -002 | 1 -002 12 | 0 0s0 | — em ~~ 
2 -003 10 | 2 029 | 1-007 | 1 007 | © -004 
1 -002 9 1 -017 1 -017 0 -002 0 -002 
0 -001 8 | 1-036 | 0 -006 | QO 006 | — A=15 B=15] 15 | 11 -0so-| 10 -021 | 9 -o08 | 8 -003 
0 -003 7 | 0-014 | Oo | — -_ 14 | 9 04 | 8 018 | 7 -007 | 6 -003 
2 6 | 0 030 | — — —~ 13 | 7 025+] 6 o10+| 5 00s | 5 -004 
“Fj I 8| 14 | 5 036 | 4 -o10-| 4 -010-| 3 -002 12 | 6 030 | 5 013 | 4 -o0s-| 4 -00s- 
_— 13 | 4 -039 3 -011 2 -002 2 -002 11 5 -033 4 -013 3 -00s- | 3 -00s- 
6 -002 | 12 | 3 032 | 2 -o08 | 2 -008 1 -001 10 | 4 033 | 3-013 | 2 004 | 2 -004 
5 -004 | 11 | 2 022 | 2 022 | 1 -oos-| 1 -oos- 9 | 3 030 | 2 010+} 1 -003 | 1 -003 
3 -002 | | 10 | 2 048 | 1-012 | 0 -co2 | O -002 8 | 2 02+] 1 007 | 1 007 | O -o01 
2 001 | 9 | 1 026 | O 004 | O -004 | O -004 7 | 1 ow | 1 018 | 0 -003 | O -003 
2 -00s- 8 | O 009 | O 009 | O -o09 | — 6 | 1-040 | 0 008 | O -oo8 | — 
1 -003 | | 7 | 0 020 | 0 020 | — — 5 | 0 02 | © 02 | — — 
0 -001 l 6 | 0 04 | — —_ a 4 | 0 -os0- | — _ — 

















Table of significance levels of b (continued) 
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Probability Probability 
a a 
0-05 0-025 0-01 0-005 0-05 0°025 0-01 
A=15 B=14!| 15 | 10 -042 9 -017 8 -006 7 002 | A=15 B=9] 13 4 -042 3 -013 2 -003 
14 8 -031 7 -013 6 -005-| 6 -005- 12 3 -032 2 -009 2 -009 
13 7 -041 6 -017 5 -007 4 -002 11 2 -021 2 -021 1 -005- 
12 6 -046 5 -020 4 -007 3 -002 10 2 -045-| 1 -o11 0 -002 
11 5 -048 4 -020 3 -007 2 -002 i] 1 -024 1 -024 0 -004 
10 4 -046 3 -018 2 -006 1 -001 8 1 -042 0 -009 0 -009 
9 3 -041 2 -014 1 -004 1 -004 | 0 -019 0 019 | — 
8 2 -033 1 -009 1 -009 0 -001 6 0 037 | — ae 
7 1 -022 1 -022 0 -004 0 -004 8 15 5 -032 4 -008 4 -008 
6 1 -049 0 O11 _— _ 14 4 -033 3 -009 3 -009 
5 | O ast} — - > 13 | 3 026 | 2 006 | 2 006 
13} 15 9 -035- | 8 -013 7 -005--| 7 -00s- 12 2 -017 2 -017 1 -003 
i4 7 023 7 -023 6 -009 5 -003 11 2 -037 1 -008 1 -008 
13 6 -029 5 011 4 -004 4 -004 10 1 -019 1 -019 0 -003 
12 5 -031 4 -012 3 -004 3 -004 9 1 -038 0 -006 0 -006 
11 4 -030 3-011 2 -003 2 -003 8 0 -013 0 013 | — 
10 | 3 026 | 2 008 | 2 -oos 1 -002 7 | 0 026 | — —_ 
9 2 -020 2 -020 1 -00s+ | O -001 6 0 -oso- | — eer 
8 | 2 043 | 1-013 | O 002 | O -002 7| 15 | 4-023 | 4 023 | 3 -oos- 
7 1 -029 0 -00s+ | QO -oost+ | — 14 3 -021 3 -021 2 -004 
6 0 -013 ee ft —_— 13 2 -014 2 -014 1 -002 
5 | 0 01 | — — — 12 | 2 032 | 1-007 | 1 007 
12| 15 | 8 028 | 7 -o10-| 7 -o10-| 6 -003 11 | 1 015+} 1 015+] © -002 
14 | 7 043 | 6 016 | 5 006 | 4 -o02 10 | 1 032 | 0 -005-| © -oos- 
13 6 -049 5 -019 4 -007 3 -002 9 0 010+ | O -o10+ | — 
12 5 -049 4 -019 3 -006 2 -002 8 0 -020 0 -020 _— 
11 4 045+ | 3 017 2 -00s-| 2 -o0s- 7 0 038 | — — 
10 3 -038 2 -012 1 -003 1 -003 6} 15 3 015+ | 3 -o1s+| 2 -003 
9 2 -028 1 -007 1 -007 0 -001 14 2 -011 2 011 1 -002 
8 1 -018 1 -o18 0 003 0 -003 13 2 -031 1 -006 1 -006 
7 1 -038 0 -007 0 007 | — 12 1 -014 1 -014 0 -002 
6 0 -017 2s a | — _ 11 1 -029 0 -004 0 -004 
5 0 037 | — _— — 10 0 -009 0 -009 0 -009 
11] 15 | 7 022 | 7 022 | 6 007 | § -oo2 9 | 0-017 | 0 017 | — 
14 | 6 032 | 5 -o1 4 003 | 4 -003 8 | 0 032 | — = 
13 5 -034 4 -012 3 -003 3 -003 a| = 2 -009 2 -009 2 -009 
12 4 -032 3 010+ | 2 -003 2 -003 14 2 -032 1 -005- | 1 -00s- 
11 3 -026 2 -008 2 -008 1 002 13 1 -014 1 -014 0 -001 
10 2 -019 2 -019 1 -004 1 -004 12 1 -031 0 -004 0 -004 
9 2 -040 1 -011 0 -002 0 -002 11 0 -008 0 -008 0 -008 
8 1 -024 1 -024 0 -004 0 -004 10 0 -016 0 016 | — 
7 1 -049 0 -010-| O -o10- | — 9 0 030 | — . 3 
6 | O 022 | O oz | — 4; 15 | 2 035+] 1 -004 | 1 -004 
5 0 046 | — — — 14 1 -016 1 -016 0 -001 
10} 15 | 6 017 | 6 -017 5 -00s-| 5 -005- 13 1 037 0 004 | O -004 
14 5 -023 5 -023 4 -007 3 -002 12 0 -009 0 -009 0 -009 
13 4 022 4 -022 3 -007 2 -001 11 0 018 0 -o18 | — 
12 3 -018 3 -018 2 -005-| 2 -o0s- 10 ¥ fe ia 
11 3-042 | 2 -013 1 -003 1 -003 3) 15 1 -020 1 020 | 0 -001 
10 | 2 029 1 -007 1 007 | O -001 14 | O -00s-| © -o0s-| Q -cos- 
9 | 1.016 | 1 016 | O 002 | O ov 13 | 0 012 | O o12 | — 
8 | 1 034 | 0 006 | O 006 | — 12 | O -02s-| © -o2s- | — 
7} 0 013 | 0 013 | — — 11 | 0 04 | — he 
sj oai- ni a5 2} 15 | O -007 | O -007 007 
9} 15 | 6 -042 5 -012 4 -003 4 -003 14 0 -022 . ae 
14 | 5 047 | 4 -015-| 3 004 | 3 -004 13 | O 044 | — si 
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The table given in § 2 enables tests of significance, at probability levels of 0-05, 0-025, 0-01 
and 0-005, to be made by direct reference for any 2 x 2 contingency table having B< A < 15. 
The section of the table for any particular pair of values A, B was constructed by giving 
to n = a+6 successively all integral values from (A + B) down to zero; for each n, b was 
given in turn'the values k, k+1, k+ 2, ... (where k is the greater of the two quantities 0 and 
n—A), P, was formed and the cumulative sum P} was recorded. The calculations with any 
set of A, B,n were stopped as soon as P¥ exceeded 0-05 or would obviously exceed 0-05 
for the next higher value of 6. The calculations were tedious, but by no means as lengthy 
as might appear from this account, for after a little experience extreme values of n, which 
would always give Pj > 0-05, could be ignored, and trends in P¥ often enabled values of 6 
which would exceed the limit to be foreseen without calculation of P,. Of course, in any case 
of doubt, P§ was evaluated. 

The probabilities were determined to five places of decimals, but any full publication of 
these would occupy a yreat deal of space. For many practical purposes, all that is required 
is a test of significance at an arbitrary level of probability. This can be conveniently made by 
use of a table showing, for each combination of A, B, and a, the greatest value of 6 for which 
P} lies beyond the chosen significance level. The values of b required can be seen immediately 
from systematic inspection of the calculations just described. For example, the calculations 
show the following 2 x 2 configurations with their associated values of P#. 














S. oes 8 3) il S ie 
2 8 | 10 1 9/10 0 0 | 10 
10 11 | 21 9 12 | 21 8 13 | 21 
P} = 0-0635 P; = 0-0226 P} = 0-0058 P; = 0-0008 
Consequently P*(b|11,10,11)<0-05 when 6<2, 


P*(b| 11,10, 10)<0-025 when b<2, 
P*(b|11,10,9)<0-01 when 6<1, 
and P*(b|11,10,8)<0-005 when 6=0. 


These values of b, 2,2, 1, and 0, are therefore tabulated in § 2 under the appropriate prob- 
abilities. The P¥ corresponding to each tabulated 6, which is usually less than the significance 
level, is shown in small type; for any smaller 6, P¥ will be even lower. From the existing 
calculations, of course, significance levels for any other selected probability less than 0-05 
could easily be read, but 0-05, 0-025, 0-01 and 0-005 seem sufficient for the present. 

The standard tables of the x? distribution (Fisher & Yates, 1948, Table IV), provide 
a two-tail test when applied to a 2 x 2 contingency table. That is to say, on the null hypothesis 
that the proportion of successes in the two populations compared are equal, and assuming 
that frequencies are sufficiently large for the sampling distributions of the proportions to be 
taken as normal, the test is based on the probability of obtaining a difference as great as or 
greater than (a/A —b/B) in either direction under conditions of random sampling. If a single- 
tail test is wanted, it can be obtained simply by entering the x? table in the column corre- 
sponding to twice the level of significance. For small frequencies, however, the discrete 
nature of the distribution for configurations with fixed marginal frequencies cannot be 
ignored, and unless either A = B or 2n = (A + B) this distribution is not symmetrical. The 
exact test of significance described at the beginning of this section is a single-tail test, being 
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based on the probability of a deviation from proportionality as great as or greater than that 
observed and in the direction of the observed deviation. In general, no deviation in the 
opposite direction will have exactly the same probability. For example, for the configuration 


10 90/| 10 
— 


we 5| 19 

1@19!14!5! 
~ IG! 10l4ts! 
No deviation in the opposite direction can be regarded as the equivalent of this either in 


the sense of having the same difference in observed proportions or in the sense of having the 
same probability; the extreme configuration at the other tail is 


the probability is P* = P = 0-0108. 





5 5] 10 
9 0 9 
14 5); 19 
for whic P* = P = 0:0217. 


If a tw »-tail test is wanted when the frequencies are small, a new convention must first be 
introduced. The only satisfactory procedure, which is consistent with the practice for 
larger frequencies (when the x? distribution is used), is to regard the two-tail probability as 
given by 2P*. In other words, the two-tail significance tests corresponding to single-tail 
tests at the conventional probability levels 0-05 and 0-01 are given by comparing P* with 
0-025 and 0-005 respectively. It is this consideration which governed the choice of 
probability levels for tabulation in § 2. 


4. SUMMARY 


This paper contains a table from which a test of significance of the deviation from pro- 
portionality in a 2 x 2 contingency table, based upon the Fisher-Yates exact probability 
method, can be read directly. Any 2 x 2 contingency table for which neither member of one 
pair of marginal totals exceeds 15 can be tested in this way, and a simple rule extends the 
applicability of the table to certain contingency tables with larger frequencies. The method 
of construction of the table is described. 


I am indebted to a number of past and present members of-my staff for the extensive and 
tedious calculations on which the table is based, especial thanks being due to Miss M. Callow. 
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THE POWER FUNCTION OF THE TEST FOR THE 
DIFFERENCE BETWEEN TWO PROPORTIONS IN 
A 2x2 TABLE 


By P. B. PATNAIK, University College, London 


1. INTRODUCTION 


Neyman & Pearson’s (1933) conception of the power of a test of a statistical hypothesis, H,, 
was developed, in the first instance as a means of guiding the choice between alternative 
tests. This, it was shown, could be done by comparing the effectiveness of the tests in 
discriminating between H, and a set of admissible alternative hypotheses regarded as most 
relevant to the question under test. Where there is no doubt about the most appropriate 
test and no sequential scheme of sampling is possible, the power function may play a useful 
part in indicating, before the data are collected, how large the samples should be to avoid 


an inconclusive result. If this procedure is to be easily applied, a ready means must be 


available of calculating the power of the test for a given significance level and sample size. 
The tables of the power function of the t-test (Neyman & Tokarska, 1936) and Tang’s 
Tables (1938) applicable in the Analysis of Variance, are examples of such aids. The present 
paper aims at providing in simple, if approximate, form a means of determining the power 
function of the test for the difference between two proportions. 

The test may be briefly outlined as follows. In two ‘infinite’ populations the proportions 
of individuals possessing a character A are p,(A) and p,(A) respectively. Random samples 


of m and n are drawn from the two populations and the result is represented in a 2 x 2 table, 
thus: 


Table 1. Number of individuals 





| With A Without A Total 





Sample from first population 








a c m 
Sample from second population b d n 
Total ? 8 N 




















We may then wish to apply the test in two forms: 

(i) The ‘two-sided’ form. To test H, that p, = p., bearing in mind the two-sided alter- 
natives that p, <p, and p, > p3. 

(ii) The ‘one-sided’ form. To test H, that p,<p., bearing in mind the one-sided alter- 
natives p, > p,. These will be referred to in the following sections as cases (i) and (ii). 

In obtaining a solution we shall regard the sample space as two-dimensioned as in 
Pearson’s (1947) Problem II or Barnard’s (1947) ‘2 x 2 comparative trial’. Fig. 1 (a) roughly 
illustrates the sample space for the case m = n = 50. A possible sampling result is represented 
by a point (a, 6) in this lattice of 51 x 51 = 2601 points. Sample points having a+ 6 = r are 
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said to lie on the ‘diagonal’ r of the lattice. In the case of small samples, or even for large 
samples when (a, b) falls near the (0, 0) or (m, ) corners of the lattice, considerable difficulties 
arise owing to the discontinuity of the distribution. We shall be concerned in the first place 
with examining the case where it is justifiable to apply the test by referring to the normal 
probability scale the ratio 








eaten ! 
u= eee, 
a... 5 
* : (1) 
“TK aE *) | : — (approx.), 


where the second and third alternative forms are equivalent to the first if the factor N — 1 is 
replaced by NV. The first form brings out the fact that w is the ratio of the deviation from the 
mean to the standard deviation, in the hypergeometric series representing the conditional 
distribution of a for r fixed. The second form arises from the classical approach in which 
a difference of observed proportions is compared with an estimate of its standard error. The 


third, when squared, gives the commonly quoted form: of the expression for y*, with one 
degree of freedom, in a 2 x 2 table. 



































0s T T — 0 
w.) a 
S : $ 
E 3 
3s = — 
> > 

50 0 

Values of a Values of p, 
Fig. 1(a). Sample space (m= n = 50). Fig. 1(6). Power contours (m = n = 50). 


Write wu, for the 100« percentage point of the normal distribution N(0, 1) i.e. 
-_ 
ua (27) 
then using the two-sided test (i), we should reject the hypothesis that p,= p, at the signi- 
ficance level a when | «| > u,,; in the case of the one-sided test, we should reject the hypo- 
thesis that p, < p, at the same significance level when u > u,. Thus, in the example illustrated 


in Fig. 1 (a), it is seen from the position of the sample point, that H, would not be rejected at 
the 5 % level if the test is in form (i), but would be rejected at the 5 % level if it is in form (ii). 


e-tu® — q, 


(1) 
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we 
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The boundaries of the critical region associated with. the tesi, taking say, case (i), are 
formed by obtaining from the equation 


the ‘cut-off’ points (a, r—a@) on each diagonal r in the lattice and joining them as in Fig. 1 (a). 
Subject to the error involved in the approximation, the chance is a that the sample point 
falls in the critical region when p, and p, have a common, though unknown, value i.e. in 
Neyman & Pearson’s notation, P{f ew, | p, = p.} = «. If in fact p, +p, then the power of 
the test of H, with regard to the alternative hypothesis H,(p,, p.) is the chance that the point 
(a. 6) falls in the critical region when sampling from populations with proportions p, and p,. 
oe P{Eew,| Py Ps} = P{|u|>%y2|P1P2} for case (i), 

= P{u>u,|p,,p2} for case (ii). 

This is the total probability density at all the discrete points (a, 6) included in the critical 
region. The problem is to express this in a readily calculable form. 

If this is done, two types of application are evident: 

(1) When the decision has been made to take two samples of, say, 50, or when the 
available data happen to consist in samples of this size, we may ask, ‘what is the chance that 
the test described will show a difference in observed proportions significant at the 5 % level 
when in fact, p, anc », are as different, say, as 0-50 and 0-65?’ 

(2) On the other hand, we may use the theory to ask in advance how large the samples 
should be so that the risk of failing to detect a given difference* between p, and p, which 
is considered to be of importance, shall be acceptably small. For example, we may ask, 
‘what sizes of samples should we take so that in applying our test we may have a high, say 
a 90 %, chance of detecting that the proportions are not equal when, in fact, they are as 
different as 0-50 and 0-65?’ 

It is clear that for given m, n and a the power of the test will be constant on certain 
contours in the p,, p. space such as those shown in Fig. 1 (6). We shall examine the approxi- 
mate form of these contours and show that in the important case when m = n = 4N, the 
family of contours is independent of N and a, although the power associated with a particular 
contour will be a function of N and «, which has been tabled. Throughout the investigation, 
approximations are made of the type involved in representing binomial or hypergeometric 


distributions by normal distributions. The adequacy of these approximations is examined 
in certain cases. 


or 


2. EXACT VALUES FOR THE POWER FUNCTION OF THE TEST BASED ON THE RATIO & 
Since a and 6 are indspendent, it follows that for the population proportions, p, and p, 


m! n! 
p(a, 6) = ae in x pigi ees (Q, = 1—p, Ug = 1— py). (2) 


If our test consists in rejecting H)(p, = p,) when |u|>w,, its power with respect to an 
alternative H,(p, +p) is the sum of the values of p(a, b) for all points (a, b) lying in the critical 
region. Exact calculation is laborious, since it involves the multiplication of terms of one 
binomial by the sums of terms of the other, which may be obtained from the tables of the 


* Neyman & Pearson have termed this the error of the second kind. 
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Incomplete Beta Function. In the special case m = 18, = 12, discussed in Pearson’s paper, 
exact values of the power function have been calculated for p,,p, = 0-1(0-1)0-9 for the 
two-sided test and for significance levels 10 and 2 %; they are tabulated in Tables 2(a) and 


Table 2(a). Power function for case m = 18,n = 12. Significance level a = 0-10 


Approximate values are shown in parentheses 





be. " 0-1 0-2 0-3 0-4 0-5 0-6 0-7 0-8 0-9 





0-9 1-000 | 0-997 | 0-975 | 0-907 | 0-773 | 0-574 | 0-356 | 0-170 | 0-088 
(1-00) | (0-999) | (0-992) | (0-96) | (0-87) | (0-70) | (0-44) | (0-21) | (0-10) 
0-8 0-997 | 0-972 | 0-882 | 0-732 | 0-494 | 0-289 | 0-144 | 0-094 | 0-202 
(0-999) | (0-980) | (0-91) | (0-77) | (0-56) | (0-34) | (0-17) | (0-10) 
0-7 0-977 | 0-880 | 0-722 | 0-487 | 0-272 | 0-136 | 0-092 | 0-159 | 0-393 
(0-987) | (0-90) | (0-73) | (0-51) | (0-30) | (0-15) | (0-10) 
0-6 0-918 | 0-742 | 0-515.| 0-287 | 0-142 | 0-099 | 0-155 | 0-320 | 0-610 
(0-94) | (0-75) | (0-51) | (0-29) | (0-15) | (0-10) 
0-5 0-796 | 0-534 | 0-309 | 0-156 | 0-100 | 0-156 | 0-309 | 0-534 | 0-796 
(0-83) | (0-54) | (0:30) | (0-15) | (0-10) 
0-4 0-610 | 0-320 | 0-155 | 0-099 | 0-142 | 0-287 | 0-515 | 0-742 | 0-918 
(0-64) | (0-32) | (0-15) | (0-10) 
0-3 0-393 | 0-159 | 0-092 | 0-136 | 0-272 | 0-487 | 0-722 | 0-880 | 0-977 
(0-40) | (0-16) | (0-10) 
0-2 0-202 | 0-094 | 0-144 | 0-289 | 0-494 | 0-732 | 0-882 | 0-972 | 0-997 
(0-20) | (0-10) 


0-1 0-088 0-170 0-356 0-574 0-773 0-907 0-975. 0-997 1-000 
(0-10) 






































Table 2(6). Power function for case m = 18, n = 12. Significance level a = 0-02 


Approximate values are shown in parentheses 
Pi 
0-1 0-2 0-3 0-4 0-5 0-6 0-7 0-8 0-9 


0-9 0-998 | 0-976 | 0-902 | 0-752 0-532 | 0-290 | 0-103 | 0-017 0-006 
(1-00) | (0-993) | (0-96) | (0-86) | (0-68) | (0-43) | (0-20) | (0-06) | (0-02) 

0-8 0-961 0-882 | 0-694 0-490 | 0-265 | 0-115 | 0-035 | 0-016 | 0-055 
‘} (0-990) | (0-91) | (0-75) | (0-52) | (0-30) | (0-12) | (0-05) | (0-02) 
0-7 0-909 | 0-714 | 0-460 | 0-248 | 0-111 0-041 0-021 0-050 | 0-177 
(0-94) | (0-73) | (0-48) | (0-26) | (0-11) | (0-04) | (0-02) 

0-6 0-767 0-500 | 0262 | 0-111 0-041 0-023 | 0-048 | 0-138 | 0-361 
(0-81) | (0-49) | (0-25) | (0-11) | (0-04) | (0-02) 

0-5 0-625 | 0-293 | 0-124 0-045 | 0-022 0-045 0-124 | 0-293 | 0-625 
(0-66) | (0-28) | (0-11) | (0-04) | (0-02) 

0-4 0-361 0-138 | 0-048 | 0-023 | 0-041 0-111 0-262 | 0-500 | 0-767 
(0-37) | (0-13) | (0-04) | (0-02) 


0-3 | 0-177 | 0-050 | 0021 | 0-041 | 0-111 | 0-248 | 0-460 | 0-714 | 0-909 
(0-18) | (0-05) | (0-02) 














0-2 | 0-055 | 0-016 | 0-035 | 0-115 | 0-265 | 0-490 | 0-694 | 0-882 | 0-961 
(0-06) | (0-02) 
0-1 0-006 | 0-017 | 0-103 | 0-290 | 0-532 | 0-752 | 0-902 | 0-976 | 0-998 











(0-02) 
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2(b).* When p, = p, the value of the power function should reduce to «. But in these tables 
we see that the values on the diagonal, p, = p, are not exactly equal to 0-10 or 0-02. The 
discrepancy is due to the fact that continuous approximations have been made to the 
discontinuous distributions in the formulation of the test. ; 

Interpolation between the calculated values in Table 2(a), leads to the power contours 
shown in Fig. 2. The test has the same power of establishing significance when sampling 
from any populations for which p,, p, lies on a given contour. The chances of establishing 
significance are written alongside the contours. The surface for which the ordinates at p,, pz 
are equal to the power, may be called the power surface of the test. 
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Fig. 2. Power contours (special case m = 18, n = 12) for significance level 0-10. 


We can see from the contour diagram that with samples of this size (18 and 12), even when 
the p’s are as different as 0-6 and 0-3 there is only a 50 % chance of establishing significance. 
If instead of the high level « = 0-10 employed here, a lower level were chosen, then the p’s 
must differ even more to give the same chance of establishing significance. Thus the diagram 
illustrates well how inadequate small samples are to establish what would ordinarily be 
regarded as a difference of some importance. 

It can also be seen that |p,—p,.| is nearly constant on a power contour near the 
middle of the square; e.g. the difference is roughly 0-3 on the 0-5 contour within the range 
(0-45, 0-15) and (0-75, 0-45). 


* For these calculations, I am indebted to the memb ors of the Statistics Department of University 
College, London, in particular to Mr V. D. Gangolli. 
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3. APPROXIMATIONS TO THE POWER FUNCTION 


We will now consider an approximation to the distribution of a under the hypothesis H,, 
under which the population proportions are p, and p,. From (1) 


N h m'in'r!s! Pale)” 
p(a,r) = init (2)" x *(tatbTetaiy (oe 


If we replace the hypergeometric term in the curled brackets by the ordinate of a normal 
curve having the mean and s.D. of the hypergeometric series, then 














(-3) 
N! %1\" 1 _N Pid 
m= vrai Pha(2) i mnrs | _ ammrs x (Bad as)" 
J(22) |= Qos io 
N*(N —1) N*(N —1) 
Writing (Ba fain)" as exp [« log, (2:2) |, collecting the terms containing a and making 
Po Poh 
a perfect square, we obtain p(a,r) = p(r) x p(a|r), 
N! an)" rm Pie mnrs ( Puts)" 
where r) = — peqai—} exp] —-log,—+ =; [| log, ——} |, 3 
P( ) qi Pee Pp N Be ed 2N2(N — 1) Be ed! ( ) 
( rm mnrs al 
@— WWW 1) Ppa, 
ond p(alr) is 1 —— exp| — N WN (N 1) P21 : (4) 
(en) co gy _mnrs 
NN —1) N*(N —1) 


Thus (4) is the approximate conditional distribution of a on the diagonal r = a+6 and is 
seen to be normal, with 
mean = + _ Jog, Pada 


N * NXN-1) p,q, 


and ap.= | 
. > 2 N*(N —1)° 


rm 
a-- 


Defining cleaislliiis. 
_mnrs 
NxN—1) 
as in (1), equation (4) becomes 


pa Se tf, |. ott) 
p(ulr) = =" exp | 3(« (mary eee 





—— 5 
Tem “ 
mnrs 
where h(r) = | mary loge (6) 


and is a function of r only, since s(= N —r) and the other quantities are given. 
If p, and p, are equal, then (5) reduces to the distribution of u under H4, 


1 
p(u) = Jen) et, (7) 
which is the normal approximation used in obtaining the test criterion. This distribution 
is independent of r; it is this fact that makes the critical regions on each diagonal r similar 


regions which can be combined into a single region in the two-dimensioned sample space. 
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But the distribution of u under H,, given by (5) is not independent of r. It is normal, 
with the same s.D. as for (7), i.e. unity, but with its mean shifted by A(r). 


What may be termed the ‘conditional power’, for r fixed, with regard to H,(p, +z) is 
then for case (i), 


— Uda 0 1 Uja—h(r) 
P(|u|>w,|r) = u|r du+{ du= 1—-—_. edu, 8 
(14 >m%4217) = |" plulp)dus [* plujrydu= 1-7 fT (8) 
ie) 1 ‘co 
d for case (ii),  P(u>w,|r) = ee eet Ww dy, 9 
and for (ii) (u>u,|r) Je peur u Jen) Marky ue (9) 


p(u|r) p(r), the ‘over-all’ power function or, simply, the power function is 


fr P(|u| >a, |r) p(r) dr (10) 


for case (i) with a similar expression for case (ii). It is clear that even with the simplified 
expression (8) for the conditional power function, depending on h(r), the labour involved 
in calculating the over-all power (10) would in general be prohibitive. Some approximation 
is therefore required for p(r), i.e. the expression in (3). The simplest approximation is obtained 
by assuming r to be normally distributed. Since a and 6 are distributed binomially with 
means mp,, and np, and S.D.’s mp,q, and np.q2, r = a+b can be considered as distributed 
normally with mean = mp, + np, and 8.D. = ,/(mp,q, + p2q2). That is, 


1 (r— (mp, + p3)) 
ptr) = V (27) (mp, qi + MP 292) mie Op 2(mp, 91 + MP 242) 
Hence, the expression (10) for the over-all power function becomes 
1 = 1 (r— (mp, +”pz)) 
\ (277) (mp9, + NP 292) J — 0 P(|m| > me |r) x exp| - 2 MP1 91 + NP2I2 “ (4) 
for case (i) with a similar expression for case (ii). 
Though problems may arise where the conditional power function would be useful, 
clearly it is the value of the over-ali power that will help in determining in advance of the 
experimental result how large the difference between p, and p, must be for the standard 


test to have a given chance of establishing significance. For in such a preliminary survey, 
cannot be regarded as fixed. 


Since p(u) = 








(11) 








4. EVALUATION OF OVER-ALL POWER 


The over-all power is a function of p, and pg, for given m,n and a and may be written as 
B( py, P2| m,n, a). Similarly, the conditional power function may be written as 

Ap, Pe | M,N, a, r). 
They will be denoted here for simplicity by # and f(r) respectively. 


Suppose 4, = mp,+npg, o? = Mg = MP, q,+NPod, and p3,f,4, etc. equal the higher 
moments of the normal distribution (11). Then for case (i) or case (ii), from (12) 


p= ee ore exp| - 4 a | aera. 


Expanding f(r) by Taylor’s Theorem, 
Bee) = Blea) + (r= aa) Boe) + SO prt) +. (13) 


II-2 
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and substituting in above, we obtain 


B= mare. xp| -S = ray 


Hy) 
+p’ (4) ai =| exp| —' 4 ae 
4 va ] a (r —/y) (r — fy)? dr + sag 

















J(2m) oJ - 202 
= (py +AU Uy _& Me a (14) 
It follows that a first approximation to the over-all power / is 
A\ Fem) yg tat for ease (i) (15) 
t e—*“'du_ tor case (1 5 
” (27) —Uja—A( pn) 
or edu for case (ii (16) 
wal Labi 44 


substituting ~, for r in the expressions (8) and (9). 
A second approximation will be derived and discussed later in section 10. 


5. COMPARISON OF EXACT AND APPROXIMATE VALUES OF THE POWER FUNCTION 


Taking the two-sided test, its over-all power has been considered in three special cases. 
Using the first approximation, the values of # have been calculated for m = 18, = 12 and 
are shown in parentheses below the exact values in Tables 2 (a) and 2(b). The exact and the 
approximate values have also been calculated for m = n = 15 and m = n = 30 for a few 
combinations of p,, p., selected so as to give high power which, as we shall see later, is in the 
range we are most interested in. These are given in Tables 3(a) and 3(b). In the latter case, 
since N is large, N —1 is replaced by N in the ratio wu. 


Table 3(a). Showing the power of the two-sided test. m = n = 15 






































Significance level, « 

Pr Ps 0-10 0-02 

Exact Firv+ Second Exact First Second 

value apy ro ¢. approx. value approx. approx. 
0-3 0-4 0-141 0-16 0-154 0-034 0-04 0-041 
0-6 0-8 0-306 0-34 0-334 0-112 0-14 0-133 
0-1 0-3 0-389 0-44 0-422 0-149 0-20 0-193 
0-2 0-7 0-896 0-92 0-912 0-680 0-76 0-750 
0-05 0-5 0-916 0-97 0-964 0-736 0-90 0-876 
0-1 0-6 0-919 0-96 0-953 0-739 0-86 0-844 
0-2 0-8 0-974 0-98 0-982 0-872 0-93 0-923 

0-1 0-7 0-980 0-992 0-991 0-894 0-96 0-954 
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Table 3(6). Showing the power of the two-sided test. m = n = 30 














Significance level, a 
0-10 0-02 

Pi Ps 

Exact First Second Exact “| First Second 

value approx. approx. value approx. approx. 
0-05 0-3 0-884 0-93 0-904 0-631 0-78 0-752 
0-1 0-4 0-885 0-91 0-903 0-691 0-75 0-736 
0-3 0-7 0-937 0-95 0-947 0-807 0-83 0-824 
0-2 0-6 0-945 0-96 0-957 0-839 0-86 0-852 
0-1 0-5 0-977 0-988 0-985 0-902 0-94 0-934 
0-2 0-7 0-993 0-996 0-996 0-965 0-98 0-974 
































From these tables it can be seen generally that (1) the first approximation over-estimates 
the power, (2) the agreement is better with large sample sizes, (3) the discrepancy is less when 
p, and p, are near 0-5 than when one or both is very small, i.e. when we are in a corner of 
the p,, p.-space, (4) the approximation is better for « = 0-10 than for a = 0-02. 

Mathematically, the approximation is of course not very accurate even with two samples 
of 30. But it must be remembered (a) that what is needed in practice is a simple procedure 
for determining quickly the chance of establishing significance, and (6) that errors of 
approximation are not everywhere of the same importance. When the chance of detecting 
a worthwhile difference between p, and 7, is only 0-40 it is clear that the sample size is 
inadequate and this would still be our conclusion if the approximation gave 0-45. It is 
perhaps only when the power approaches 0-90 that an error of this order becomes serious. 
If the true chance were 0-90 (odds of 9 to 1) and the approximation gave 0-95 (odds of 19 to 1) 
the result becomes somewhat misleading on this basis. Examination of Tables 3(a) and 
2(b) suggests that if one value of p is likely to be less than 0-1 or greater than 0-9, the 
approximation is failing us for n < 30. But even here, as shown on p. 170 below when esti- 
mating the sample size needed to provide a given power, using Tables 4 and 5, we shall not 
be far out. 


6. CASE OF EQUAL SAMPLE SIZES 


Suppose m = n = $N. Then yu, = n(p,+ p,). Substituting in (6) and replacing N*(N —1) by 
N3( = 8n°), the error being negligible when is not too small, we find 


Bys) = yn lea +74) (2—Pr— Py) 0g, ACP. 
In the case of the oné-sided test, where the alternative is p, > p., A(#,) is positive. In the 
other case with alternatives p, <p, or p, > Pg, A(u,) is negative or positive. But from the 
expression (15) for the approximate power, it is seen that the sign of h(y,) is immaterial. 
So, putting h = |h(u,)|, 


a . Ps(1—Ps) 
k = k(p,, Ps) = “Fvi(pit Ps) (2-21 — Pa)] | log. pall — oa , (17) 


we have h = kyn. - (18) 
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From (15) and (16) it follows that to the first approximation, for given n = 3N and a, the 
power, /, is a function of k only, i.e. 


R( Py Pe | n,n, a) = Bk | n, a). 
These contours of constant k have been drawn in Fig. 3 and the values of k are written 


alongside. Thus for m = n the values of p,, p, and the power of the test may be linked up 
as follows: 


(i) Fig. 3 relates p,, p, to k. 
(ii) Equation (18) gives h in terms of k and n. 


(iii) The normal integrals (15) and (16) give the power in terms of h and the significance 
level « employed in the test. 


It will be seen that to the first approximation the composite hypothesis, 
Hy(p, = Pz = p, unknown), 


is reduced to a simple hypothesis, k = 0. So the test in this case may be regarded as the test 
of the hypothesis, k = 0, with alternatives, k > 0. 


7. TABULATION 
(1) Tables of k as an alternative to Fig. 3. From (17), k has been calculated for 
Pi; Pz = 0°05(0-05) 0-95 
and is given in Table 4 (printed at the end of the paper, p. 174). Since k(1—p,, 1—p,) has 


the same value as k(p,, p.) the figures in the upper part of the table (p. > p,) are not printed. 


(2) Table 5. The power as a function of h = k,/n and «. For the two-sided test we require 
the integral (15). Denoting this by P, i.e., 


l Uja—h ~ put 


—Uja—h 
the value of P is given in columns 2-5 of Table 5 (printed at the end of the paper, p. 175). 
It has been calculated from Tables of Probability Functions, Vol. 1 (Federal Works Agency, 
New York), using Lagrangian four-point interpolation, for the levels 


a = 0-10,0-05,0-02 and 0-01 and for h = 0-1(0-1)3-0(0-2) 5-0. 
As h increases, the contribution to this integral from one tail rapidly becomes negligible, 
so that (19) approximates to 1 fe 
(27) J uja—h 


From (16), we see that this integral is the power of the one-sided test, applied at the 
significance level $a. The points at which this result is obtained to a given level of accuracy 
are shown in Table 5; at least two-decimal accuracy occurs below the mark *, three- 
decimal accuracy below {, and four below {. 

To facilitate the use, values of k = h/,/n have been tabulated in the right-hand side 
of Table 5 corresponding to the / values in the first column and for 


et? du, 


n = 10(5) 50(10) 100, 150. 


Linear interpolation is adequate for Tables 4 and 5, except in the corners of Table 4 
where Lagrangian four-point interpolation may be necessary. 
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8. APPLICATION OF THE POWER FUNCTION AND USE OF TABLES 


Illustration 1. Laurence & Newell, while experimenting with the composition of soil 
composts, recorded the following results of a germination trial with Primula sinensis seeds 
(quoted in Statistical Analysis in Biology by K. Mather, 1946, p. 193). Two equal-groups of 
seeds were allowed to germinate in dishes containing filter papers soaked respectively in 
rain water and in water allowed to seep through loam before use. 














Table 6 
Germinated | Ungerminated Total 
Loam water 37 13 50 
Rain water 32 18 50 
Total 69 31 100 

















To test if the type of water affects germination, wu has been calculated to be 1-11 and 
referred to the normal probability scale. It is seen that there is no significant difference 
at the 5 % level. 

It might be asked what magnitude of difference could we hope to detect using two 
samples of 50. Suppose, for example, that for these populations 80%, say, of seeds will 
germinate in loam water and 60% in rain water; what would have been the chance of 
establishing significance at 5 % level? 

To obtain this, we find from Fig. 3 or from Table 4 the value of k for p, = 0-8 and p, = 0-6. 
From Table 4 it is seen to be 0-318. Then we enter Table 5 in the column of » = 50 and 
find that this value of k lies between the tabulated values, 0-311 and 0-325. They correspond 
to the figures 0-5949 and 0-6331 in the column of P for a = 0-05. So, the first approximation 
to the power lies between these values and by linear interpolation is found to be 0-61. If 
the level chosen for the test is a = 0-01, we find that the power is only 0-37. Clearly this 
indicates that with two samples of 50, there is a very considerable risk of failing to establish 
significance when the difference in chances of germination is of this order. 

Suppose now we asked how large the samples should have been to give a chance of 0-9 of 
establishing significance when the true percentages germinating are 80 in loam water and 
60 in rain water? We then proceed as follows: In Table 5, entering the column of P under 
a = 0-05, we find that 0-90 lies between 0-8925 and 0-9251 and following the rows of these 
figures we see that k = 0-318 lies between the figures in the columns of n = 100 and x = 150. 
As the interval is too wide for interpolation we find h in column | corresponding to P = 0-90 
in column 3 and then from the relation, n = h?/k*?, we obtain n to be nearly 105. If the level 
chosen is a = 0-01, the samples should be of size 150 to give the same power. 

Illustration 2. In the early stages of production of an important piece of electrical 
equipment, it has been found that the percentage of units failing under test varies, according 
to the batch, between 30 and 40 %. An adjustment is suggested which would be considered 
worthwhile if it leads to a 50 % reduction in failures. A trial is planned in which N = 2n 
units are selected at random from a batch, half are adjusted and half not and the whole are 
then tested. We want to know in advance about how large should n be so that the odds are 








168 The power function in a 2 x 2 table 


19 to 1 that we shall not reach an inconclusive result (at the 5 % level) if there has been 
a 50 % reduction in failures. 

Here p, = 0-30 to 0-40 and p, = 0-15 to 0-20. From Fig. 3 we see that the contour, k = 0-3 
roughly passes through the range of these points (p,,p,). From Table 5 we find h = 3-3 for 
P = 0-95 and a = 0-10 (since the test is of the one-sided form). So, n = h?/k? = 120, nearly, 
a surprisingly large number. 


104-1 . 1 ‘ ail . 








09 +0*9 


+ WO Hy 
aS LAMY /|I Se 
os] IZ, A] Th a 
ve Xs LLY Mi, 


Va y » VA 


PE a 


YOY 














Values of p, 
Values of p, 





03 A 


7 
< AL, 





NN 
N 
SS 









































7 ae 7 7 OX _ 
ah LAE I. 
, Z SSO ZED a 





er a ee ee ee ee ee ee ee ee 
‘Values of p, 


Fig. 3. Contours of constant k for use in determining the power when m=n. 
(Values of k are printed alongside the curves). 


Sometimes, without precisely specifying p, or p, we may consider an improvement 
worthwhile if it increases the percentage of effectives by a fixed amount, e.g. such that 
P2—P; = 9-25. Table 4 shows how this difference is roughly constant for k constant in the 
central area; for example, 

















Py Ps ke 
0-20 0-45 0-393 
0-25 0-50 0-376 
0-35 0-60 0-362 
0-45 0-70 0-366 
0-55 0-80 0-393 








That is, the contour k = 0-38 passes very closely through these points (p,, p,). With this 
value of k we obtain n as before. 

Illustration 3. If we have a random variable x following a distribution law which is 
approximately normal, the most efficient estimator of the population mean, ,, is the sample 
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mean Z. On the assumption that the variance is not changing appreciably, we should use 
the t-test to determine whether there has been a change in « between the drawing of a first 
and second sample. Practical requirements sometimes make it preferable, or even necessary, 
to observe only the number of individuals in the two samples, say a and 6 respectively, for 
which z falls below a fixed level x). We can then test whether there has been a change in 4 


with the help of the ratio w of equation (1), p, and p, being the chance that x<-, for the 
first and second samples, respectively. 
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Fig. 4(a), (0). 


Examples of this problem occur: 

(i) In firing two types of shot, with striking velocity x», against a standard proof plate 
and observing the numbers, a and 6, that fail to perforate. 

(ii) In dosage-mortality problems, where two drugs are compared only at a single dosage 
level, xp. 

The value of x, will frequently be at our choice and the generally accepted principle is to 
take a value so that P{x <2} is in the neighbourhood of 0-5. It is possible to confirm the 
soundness of this procedure in terms of the power function of the u (or x*) test. Fig. 4(@) 
represents two normal distributions with means /, and /, and a common standard deviation, 
o. p, and p, are the proportionate areas under the curves below x = 2». For a given relative 
shift in mean, 6 = (#,—/,)/o, values of p, «nd py as functions of x are readily found from 
tables of the normal probability integral. Fig. 4(b) shows, as solid line curves, the locus of 
points p,, p, for which é = 0-5, 1-0 and 1-5. Our problem is to determine, for given 6, the 








170 The power function in a 2 x 2 table 


value of 2) which will maximize the chance that the u-test will establish significance. We 
know that in large samples of equal size (m = n), the power of the test is constant on the 
contours of constant k (equation (17)). Two of these contours, for k = 0-20 and 0-63, 
approximately, are shown as dotted lines in Fig. 4(b); they touch the curves for 6 = 0-5 and 
1-5, respectively, at the points where p,+p,. = 1, and elsewhere fall beyond them, as 
shown. 

Since for small samples, we have found that the k-contours rather overestimate the power 
when p, or p, approach 0 or 1, it follows that the true power contour which touches a é-curve 
where p, + pz = 1, will fall even further outside it, towards the corners of the diagram, than 
the k-contours, as drawn. It appears therefore that: 

(i) For a given 6, the usual test for a difference in proportions has a maximum chance of 
establishing a difference if x) = $(~, +.) and this is so for all levels of the power function.* 

(ii) When m =v are large and the true power contours become exactly those of 


k = constant, shown in Figs. 3 and 4(6), p,+p, may differ considerably from 1-0 without 
appreciably reducing the power of-the test. 


9. THE ERROR IN ESTIMATING THE SAMPLE SIZE NECESSARY 
TO ENSURE A GIVEN POWER 


In section & it has been seen that the power obtained by the first approximation is generally 
an over-estimate of the true value. The effect of this will be to underestimate n in carrying 
out the procedure illustrated in the previous example. It is possible to determine the 
magnitude of this error in the neighbourhood of n = 15 and 30, where the exact values of the 


power have been found and are given in Tables 3(a) and (b). Some results of this comparison 
are shown in Table 7. 


Table 7. Comparing the estimates with the true values of the sample size, n 









































T a h for true power Estimate of 
taeal from Table 5 n == h2/k? 
k from 
uaeeee! SS. Pa Table 4 
For For ae es pa, a 
a=-0:10| a= 0-02 a=0-10 | a=0-02 |}a=0-10) a= 0-02 
15 0-05 0-5 0-916 0-736 0-930 3-03 2-96 11 11 
0-1 0-6 0-919 0-739 0-878 3°05 2-97 13 12 
0-1 0-7 0-980 0-894 1-055 3-71 3°58 13 12 
30 0-05 0-3 0-884 0-631 0-563 2-84 2-66 26 23 
0-1 0-5 0-977 0-902 0-712 3°65 3-62 27 26 
0-2 0-7 0-993 0-965 0-786 4-12 4-15 28 28 














* The power of the two-sided test. 
For example, if p, = 0-1, p, = 0-6, Table 3(a) gives the true power for m = n = 15 as 


(i) 0-919 using the test with a 10 % significance level and (ii) 0-739 using the test with a 2% 
level. Suppose now that we were to use Tables 4 and 5 to estimate how large the sample 


* For m = n = 30, Table 5 shows that for k = 0-20 and for a significance level « = 0-05, the two-sided 
test has a power of a little under 0-20 and for & = 0-63 of a little under 0-93. 
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must be to give chances of 0-919 and 0-739 of establishing significance at the 10 and 2% 
levels respectively, when p, = 0-1, p, = 0-6. From Table 4 we find that & = 0-878 and 
interpolating in the second and third columns of Table 5 we obtain h and so n, thus: 























a a h n = h?/k* 
0-919 0-10 3-05 12-1 or 13, 
taking the next higher integer 
0-739 0-02 2-97 11-4 or 12, 
taking the next higher integer 





The Table shows the extent of the underestimate of n. The error will become relatively 
smaller as n is increased; but some adjustment is clearly desirable. 


10. A SECOND APPROXIMATION TO OVER-ALL POWER 


The first term in the right-hand side of (14) has been taken as the first approximation to the 
over-all power. The other terms decrease fast since the higher derivatives, £"(u,), P(,), ... 
rapidly approach zero, and a good approximation may be obtained by taking a few of these 
terms. We will, however, derive a second approximation by a slightly different approach. 

The method of approximate product-integration developed by R. E. Beard (1947) could 
be employed to express f as a weighted sum of terms A(r,,) where r,, 79, ...,7,, are n values 


which might or might not be fixed beforehand. Considering only three such levels of r, we 
write formally 


| A(r) p(r) dr = {a,B(r,) + 42 A(r2) +a,6trs)3f p(r)dr. (20) 
Expand the functions f(r), £(7,), 2(7,) and A(r,) by Taylor’s Theorem to six terms as in (13) 
and write the remainder terms after the sixth. Then identifying the coefficients of 
Bly), By) ++) BUM) 
on both sides of (20), we have the equations a,+a,+a,=1 
Ay (7, — fy) + Ag(%'2— fy) + 2g(73— fy) = O 
A,(7, — fy)" + a,(r2 — fy)? + A5(73 — fy)? = He 
€y(7y — #44)? +. 4,(72— #4) + A(7'3— y)° = 9. 
Expressing the higher moments of the normal distribution p(r) in terms of #,, these equations 
yield the solution: g, — q, = }, a, = 3. 


Ty = My —V(3f2), 2 = Pay 73 = A + (3M). 
Since the left-hand side of (20) is £, it follows that 





B= (Ply — V(32)] + FR (ea) + BFL + VB eQ)] + B, (21) 
where R depends on the four remainder terms of the expansions f(r), ..., (rs). It can be 
shown that 6) 2 6) 

R= saa (n.— 22) = aa Gus (—0<§<00). 
! a) . ! 


We may now compare the expression for f in (21), with that in (14). Expanding the two 
functions A[ ji, —./(342)] and A[w, + ./(34)] by Taylor’s Theorem, we see that the right-hand 


” 4) 
side of (21), without R, includes the terms A(,), ee) fra eo a of (14) completely 
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and the following terms partially. This is also seen by comparing the form of R with the 
form of the remainder term of (14) after the sixth, R, = #(£) u,/6!. Clearly, 

B= Blea — V(32)) + $B (4a) + BAL + J (3442)] (22) 
gives a better approximation than 


(4) 
p= Ay) +2 or A, 





As it is also easier to calculate, we will ss ae (22) as our second approximation to the 
over-all power function. 
We can get a similar formula with equal weights, namely 


p= 5 {| nS] + 60) +6] +24), 


Unlike (22), this is derived by using only the first three moments of the distribution of r. 
More generally, using only the first three moments, we have 


p= 53 Alis—¢ (aa) + Ply +c/( Me) ]}}+ (: -3) B( Hy}. 


where c can be chosen as we like, subject to the restriction that none of the arguments 
should become negative. 

In section 8 we have seen how the over-all power for equal samples could be obtained to 
the first approximation, f(,). For the second approximation (22) the values of B[u, + «/(3)] 
and f[, —./(3_)] may be obtained in the same manner by entering Table 5 with the values 
of h{,+./(34)] and h[~,—./(34_)]. From (6), with m = n, we have 


h[w,+ Na 


fin Py + P2) + [30(p191 + P2I2)]) (20 — mp, + Pe) — V[30(P191 + P2492) ]} log 


Putting h, =| h{u,+./(34,)]|, this becomes 
es b {i+ aa Po) V[3(p191 + P292)] — aries Pt) 
= 
(P+ P2) (2—Pi— Po) 
where k is the expression (17). Similarly if 


he = | hl, —V(32)] |, 
then th we b+ — 2(1—p,— Po) \[3n(pid petal weiss Pad 
° n(P; + Pe) (2— 1 — Po) 
h, and h, can be calculated by obtaining k from Table 4 Le substituting the values of k, p,, p. 
and 7 in these two expressions. 

If P,, P, are the tabulated values of the integral P of (19), corresponding to h,, h, and if 

P is the value corresponding to h(y,), then the second approximation is 

f= WUP+P+4P). (23) 
The value of n obtained from Table 5 as described in section 8, may be improved with the 


help of the second approximation. Taking this value of n we calculate h, and A, and obtain 
the corresponding P, and P,. Then from (23), 


P= $/-1(P,+F). 
With this P we enter Table 5 again and find the improved n. 
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[From Biometrika, Vol. 46. Parts 3 and 4, December 1959.} 
[AU rights reserved.] PRINTED IN GREAT BRITAIN 


CORRIGENDA 


(1) Biometrika (1948), 35, pp. 157-75 


“The power function of the test for the difference between two proportions in a 2 x 2 table.’ 
By P. B. Parnark. 


I am indebted to Mr R. L. Turner for pointing out some errors in formulae on pp. 172-3 
of this paper: 


(a) p. 172, the expressions for h, and h, should read 


ho b {ng Oa — Pa) [327,91 + P292)) — 3(Pi% +Paty) 


(91+ Pe) (2—p, — pe) 
=k [n+ — 2(1— Py Pa) V(32( P14 + P22) — Mest + Paty) 


(Py; +92) (2- Pi—P2) 


(6) p. 173, in equation (25) for ga +01—p, — Pe) read (1 + O(1 — py) — pa), an 
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The values of the over-all power have been calculated on this second approximation for 
certain cases and shown alongside the first approximation values in Tables 3(a) and 3(6). 


It is seen that the second approximation improves the first, although it does not remove 
all the error. 


11. GENERAL CASE OF UNEQUAL SAMPLE SIZES 
The first approximation to the over-all power depends on 








hy) = ja + “eS — mp, — “Ps log, 2222, (24) 
P2h 
taking N* instead of N*(N — 1) in (6). 
Suppose 0 = m/n then 
N 20 al Pile 
= ad = 15 | aga Ors + Pa) 1+ 01,79} |Iog, Dats 





= ($4) k(), say. (25) 


k(@) corresponds to k in the case of equal samples, but in general it is a function of 6 as well 
as p, and p,. If @ is known, as for example, when m and » are given, the k function defines 
as before a family of contours of constant power in the p, p, plane. 

To obtain a first approximation to the power, we evaluate h(z,) from (24) or (25) and enter 
Table 5. For the second approximation we have to evaluate also h[, + ./(3)] and as before 
obtain the weighted sum of the corresponding P’s 

The converse problem of determining the sample sizes for a given power can be solved 
only if the value of @ is given. For example, we may ask, ‘What sample sizes should we take, 
one being double the other if we want a 90 % chance of detecting a significant difference 
when p, and p, have certain specified values?’ 

First we calculate k(). From the given power we obtain hk from Table (5). Then N = k*()/h? 
will give N to the first approximation. Since @ is given, m and n are obtained. 


12. SUMMARY 


The power function of the test of significance for the 2 x 2 table has been considered and an 


approximate method of deriving it has been developed. The usefulness of the idea of power 
in fixing in advance the sizes of samples is indicated. 


Tables have been provided for determining the power for a specified alternative, the 
samples sizes being given and conversely. 


I wish to express my grateful thanks to Prof. E.S. Pearson and Dr H. O. Hartley for their 
guidance in the study of this problem. 
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THE ANALYSIS OF CONTINGENCY TABLES WITH GROUPINGS 
BASED ON QUANTITATIVE CHARACTERS 


By F. YATES 


A pxq contingency table can be tested for independence by a x? test with (p—1)(q—1) 
degrees of freedom. This is an over-all test which covers all forms of departure from 
proportionality, and is consequently correspondingly insensitive to departures of a specified 
type. 

If the nature of the data is such that departures of a particular type are to be expected, 
then a test of significance appropriate to departures of this type will be justified. 

The present paper deals with the case in which one or both groupings are based on 
characters which are either directly quantitative or are in the form of gradings which can be 
regarded as having an underlying quantitative basis. The actual data which gave rise to the 
investigation are shown in Table 1. They were obtained in the course of a pilot inquiry into 
the conditions in which school children do their homework, carried out by the Department 
of Social Science, University of Liverpool, and I am indebted to Mr D. Chapman for 
permission to reproduce them here. 


Table 1. Relation (in terms of numbers of children and percentages) between conditions under 
which homework was carried out, and the teacher’s rating of the quality of that homework. 
(Each scale is graded, A being the highest rating) 












































Homework conditions 
Teacher’s 
rating 
A B C D E Total 
A 141 (46%) 67 (46 %) 114 (39% 79 (44%) 39 (43 %) 440 (43%) 
B 131 (42%) 66 (45%) 143 (48%) 72 (40%) 35 (39% 447 (44%) 
C 36 (12%) 14 (9%) 38 (13%) 28 (16%) 16 (18%) 132 (13% 
Total 308 (100%) | 147 (100%) | 295 (100%) | 179 (100%) | 90 (100%) | 1019 (100%) 











It is clear from the percentages that the effect of homework conditions on the quality of 
the preparation, as judged by the teacher’s rating, is small. On the other hand, there is some 
slight trend, and the question therefore arises whether this trend has any significance, or, 
more generally, what is its estimated magnitude, and what are the errors of this estimate. 

A x? test of the whole table gives a value of x? equal to 9-16 (8 degrees of freedom), but 
such a test, as pointed out above, embraces all types of deviation from proportionality. 

In material of this kind a rough test, which isolates the major part of any quantitative 
association between the two variates, can be made by reduction of the table to a 2 x 2 table 
by the grouping of appropriate parts and rejection of others. With the above data we might 
reasonably group homework conditions A and B, and D and E£, rejecting condition C, and 
also reject the teacher’s central rating B. This will give the values of Table 2. 
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This Table gives a value of x7, i.e. x corrected for continuity, equal to 3-03 (1 degree of 
freedom), corresponding to a probability (for one tail of the x, distribution) of 0-041. (The 
use of a single tail is appropriate to testing whether there is evidence that improved condi- 
tions of homework improve the quality of preparation, ruling out the opposite contingency.) 
The test therefore indicates that there is significant evidence (at the 5 % level) of some 
improvement. 

The above rough test, however, is open to several objections. In the first place, since the 
grouping is arbitrary, there is always a possibility that the statistician will allow himself 
to be influenced by the data in his choice of grouping, a grouping which gives a high degree 
of association being chosen. If this occurs, the test of significance is clearly vitiated. Secondly, 
different workers may-in good faith choose different groupings of the same data, and this 
may lead to arguments of a type that are likely to discredit the science of statistics. Thirdly, 
the choice of grouping which is most appropriate in any given case depends on the marginal 
totals of the numbers of observations, and simple rules for the choice of grouping are not 
easy to devise. Fourthly, the test provides no estimate of the magnitude of the effects of 
the association. 

Table 2. Condensation of part of Table 1 

















Homework conditions 
Teacher’s 
rating 
A+B D+E Total 
A 208 (81%) 118 (73 %) 326 (78%) 
Cc 50 (19 %) 44 (27%) 94 (22%) 
Total 258 (100 %) 162 (100%) 420 (100 %) 




















The test based on regression concepts, developed below, eliminates the element of choice, 
requires no elaborate computation, and also provides estimates of the magnitude of the 
effect of each variate on the other. 

The following notation will be adopted. Letters without dashes will be taken to indicate 
the results of operations on the rows, and with dashes the results of the same operations on 
the columns. The r row totals will be denoted by N,, Ng, ..., the r’ column totals by Nj, .N3,..., 
and the grand total by 7’. We shall also require an extended summation notation, in which 
the z’s may denote any set of r quantities, as follows, 

So(x) = 21 +%_t...+%,, 
S,(w) = —U(r—1)2,—4(r—3) ay—... + (7-1) 2, 
S,(x) =}(r—1)?9 2, + }(r—3)?2.4+...+ r—1)*2,, 
with three similar functions extending to r’ terms distinguished by dashes. 

For each of the r’ columns a mean score is calculated, assigning a score of — $(r— 1) to the 
first row, — }(r—3) to the second row, etc: and + }(r—1) to the last row. If the numbers in 
the different sub-groups of the first column are 7,, %g, ..., %,, the mean score for the column is 


x 1 
y= Wi Sul)» 
and the total score is Us, = S,(n). 
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178 The analysis of contingency tables 
If the numbers 7,, %, ...,2, are regarded as a sample from a multinomial distribution 
with probabilities of, say, p,,p.,...,p,, the variance of n, will be Njp,q,, and the co- 


variance of n, and n, will be —Njp,p., etc. The variance of u, can then be simply 
calculated, and will be found to be 


V(ui) = wlSup) ~{8,(p)}*}. 


The regression of the mean scores uj, u;, ..., u, for the r’ columns on column number can 
now be calculated, weighting according to the variances of the u’’s, provided we can make 
some assumption as to the values of the p’s. 

In order to obtain a test of significance we may start with the hypothesis that the sets of 
p’s are identical for all columns, i.e. that p, is the same from column to column, etc. Then 
the variances of the w’’s are inversely proportional to the numbers in the columns, i.e. the 
N”’s, and in calculating the regression we may therefore take weights equal to the N’’s. 
Estimates of the values of p’s may be derived from the row totals, so that p, = N,/T, etc., 


when we shall have l 
V(u;) = ye pal TSN) — 15, (N)}"1, 
etc. 
If the regression equation is taken in the form 
u, = m'+b'{x—Fr+ 1)}, 
the equations of estimation for m’ and b’ are: 
m’So(N’)+6'S}(N’) = S4(U’),  m’S}(N’)+6’S(N’) = 8{(U’). 
We have So(N) = So(N’) = 7, 8,(U’) = 8,(N), ' 
S,(U) = Si(N’), $,(U) = S40’). 
A = TS,(N)—{S,(N)}, 
A! = TSN’) —{S(N')}, 
B = TS,U)—S,(N) S\N’), 
the solution of the above equations gives b’ = B/A’, with the corresponding regression on 
row scores b = B/A. 
The variance per unit weight is A/7*, and consequently 
ro wf 
aa ae 
Similarly, V(b) = A’/AT. The appropriate test of significance is therefore given by 
v= A ¥ od _ BT 
: V(b) V(b’) AA’ 


If we put 


Il 


V(b’) 





with one degree of freedom. 

The above test is unaffected by interchange of rows and columns, as should be the case. 
It can easily be verified that the test reduces to the ordinary x? test of a 2 x 2 contingency 
table (apart from the correction for continuity) if the values in all but two of the rows and 
two of the columns are put equal to zero. The correction for continuity is not here of 
importance in view of the large number of possible alternatives with given marginal totals. 

The test has been arrived at by assuming that the column totals only are fixed, but with 
the additional approximation involved in assuming that the p’s for each column are given 
by the marginal totals for the rows. This appreach has the advantage of indicating the 
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appropriate criterion B®7'/A A’ for the type of association which it is desired to test. Once 
the criterion is determined, however, it can be shown, following Fisher (1922, 1925), 
that this criterion, which is linear in the deviations from expectation, and orthogonal with 
the linear functions representing the row and column totals, will in large samples be 
distributed as x? with 1 degree of freedom when both sets of marginal totals are held fixed. 

The values for the regression coefficients b and b’ give estimates of the change in mean 
score with unit change of row and column respectively. It should be noted that the variances 
of b and b’ given above are based on the assumption that there is no association between the 
two variates and become progressively more inaccurate as the degree of association increases. 
In general they will be over-estimates of the true variances. Nothing more accurate is likely 
to be required, however, except when there is very marked association, in which case the 
assumption of linear regression in the mean scores over the whole range is unlikely to 
provide an adequate mathematical description of the association. 

If only one of the classifications, say the rows, is quantitative, a test for the homogeneity 
of the mean scores for the columns may be derived from the variances of these mean scores. 


The quantity on s,( ’2 ) Sofa’ /V(w’)} 2 
= 0 =. 





V(u')} == Sof/V(u’)} 
_ TT (UU) _ {SU} 
=F 8( 5) -§*] 
7T2 
= = ([So(u'0") — w'S(0")], 


where w’ is the mean score for all the observations, will be distributed as x? with r’ — 1 degrees 
of freedom. It is easily verified that this test reduces to the ordinary x? test for a 2 x r’ table 
when there are only two rows. 

It may be noted that any system of scoring may be assigned to each of the classifications— 
there is no need to adopt a system with equal intervals between each class if the nature of 
the classification is such that scoring with unequal intervals is more appropriate. If, for 
example, in the data of Table | the teachers had given their opinion that the difference 
between their classes A and B in quality of preparation was only half that between B and C 
scores of + 1,0, and —2 might have been adopted. In the absence of any such indications, 
however, the appropriate procedure will be to assume that graded classifications are intended 
to represent equal intervals on some scale, unless the data themselves are used to determine 
the optimal system of scoring, by some procedure analogous to that given by Fisher (1946), 
para. 49-2, or by reference to some assumed distribution of the scores in the population. 
Examples of the latter procedure are described by Pearson & Moul (1925), and also in 
K. Pearson’s Tables for Statisticians and Biometricians, Part 1, pp. xxiii-xxvi (1931). In 
this connexion see also E. S. Pearson (1923). Such procedures, however, are only likely to 
be worth while in exceptional cases, and with very extensive data. 

The computational procedure when the scores are assumed is very simple, and is illustrated 
in Table 3 for a 4x 5 table with quantitative classifications. The scores used for the rows 
have been multiplied by 2 for convenience in computation. The value of 6 obtained will 
therefore represent half the change to be expected in the mean score from row to row. 

The total scores U and U’ in Table 3 are calculated by summing the products of the scores 
and the numbers in the corresponding sub-classes. Checks are provided by carrying out 
the same operations on the totals. S,(N) and S,(N’) are obtained by multiplying the totals 


T2-2 
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N,, Nz, ---, and Nj, N3,..., by the squares of the scores. These must be checked. S,(U) is 
obtained in two ways by summing the products of the U’s and the U”’s with their 
corresponding scores. 

The quantity A is then obtained from the last three values in the total column, A’ from 


the last three values in the total line, and B from the cross product of the 2 x 2 table formed 
by the total and total score rows and columns. 


Table 3. Computational procedure 
(Score)? 4 1 0 a | 


























Score —-2-1 0 +1 42 
(Score)? Score A) 2 - DB Total Total score 
} 
9 -—3 A —- —- — —_ N, U, 
1 -1 B —- — —_— Nz Uz 
1 +1 Cc =_-_-- -—- — N3; U; 
9 +3 D —- —- —- — — N, ‘ 
Total N,N, NS NN; T S,(U) = S\(N’) S,(N’) <A’ 
Total score : Us Us Us Us| SoU’) =S(N) SU) =S\(U’) 
S\N) hy 
t 
A 
Table 4. Analysis of the data of Table 1 ' 
Homework conditions 
(Score)? 4 1 0 1 4 
Score +2 +1 0 -1 —2 
Teacher’s Total iotal Mean 
(Score)? Score rating A B Cc D E |Total score {score)?® score 
1 +1 A 141 67 114 79 39 440 +192 +0-44 \ 
0 0 B 131 66 143 72 35 447 +186 + 0-42 
1 -1 C 36 14 38 28 16 132 + 26 +020 
Total 308 147 295 179 90 1019 +404 1918 + 0-40 
Total score +105 +53 +76 +51 +23 |+308 +166 
Total (score)? 572 
‘ 
Mean score +0°34 +0-36 +0-26 +0-28 +0-26 |+0-30 








The analysis of the data of Table 1 is given in Table 4, which also shows the mean scores 
(not required in the analysis). From the values of this table we have: 


A = 1019 x 572— 308% = 488,004, 
A’ = 1019 x 1918 — 4042 = 1,791,226, 
B = 1019 x 166—308 x 404 = 44,722, 
b = B/A = 44,722/488,004 = 0-09164, 
b’ = B/A’ = 44,722/1,791,226 = 0-02497, 








') is 
heir 


rom 


ned 


+A’ 


cores 


F. YatTEs 181 


S.E. ofd= | 45 - Jf aaeaon c10i8 Lee = +0-0600, 


488,004 x 1019 


488,004 
on. EE Jz AT J 1,791,226 x 1019 ~ + °'0168, 


was BT 44,722? x 1019 
~ AA’ 488,004 x 1,791,226 


Reference to a table of the normal integral indicates that P = 0-062 (one tail), and there 
is therefore a probability about 1 in 16 of obtaining by chance as great an apparent improve- 
ment as is indicated by the data, if homework conditions have in fact no influence on the 
quality of the homework as shown by the teacher’s rating. More important, in data of this 
kind, the analysis indicates that the amount of improvement, if any, is likely to be small. 
In terms of the improvement to be expected in changing conditions from the worst (Z) to 
the best (A) the estimated improvement, 4b’, is 0-100, the limits given by once and twice 
the standard error being + 0-03 to + 0-16 and — 0-03 to + 0-23. We may therefore state that 
the true value of this improvement is not likely to be substantially greater than + 0-16 and 
is almost certainly not greater than + 0-23, nor is it likely to be substantially less than 
+ 0-03, and is almost certainly not less than — 0-03. 

It will be noted that the exact test in this instance gives a lower degree of significance than 
the rough test based on reduction to a 2 x 2 table. This, of course, does not imply that the 
exact test is less sensitive. With any given set of data the verdicts of different tests of 
significance may differ considerably owing to chance causes. This does not preclude the use 
of rough tests when considerations of speed and computational labour are paramount, but 
once the exact test has been evaluated the verdict of the simpler but less appropriate test 
must be set aside. The decision as to the test to be used should also be made without 
reference to the actual data—it is, of course, inadmissible to make a rough test, accept its 
verdict if significant, and proceed to an exact test if it fails to indicate significance. 

As an example of the computations when one classification only is quantitative we may 
test the deviations between the mean scores for different homework conditions. This test 
would be required if the homework conditions were qualitative categories and not an ordered 
series. In this case the value of xy? for 4 degrees of freedom will be given by 

1019? 
+ 488,004 

= 3-825, 
the mean scores being taken to 5 and 6 decimal places to ensure the necessary accuracy. It 
is clear that apart from the linear trend there are no significant variations in mean score. 








= 2-332. 


(105 x 0-34091 + ... — 308 x 0°302257) 


REFERENCES 
FisHer, R. A. (1922). J. R. Statist. Soc. 85, 87. 
FisHER, R. A. (1925). Metron, 5, 3. 
Fisuer, R. A. (1946). Statistical Methods for Research Workers, 10th ed. Edinburgh: Oliver and Boyd. 
Prarson, E. S. (1923). Biometrika, 14, 261. 
Pearson, K. (1931). Tables for Statisticians and Biometricians, Part II. London: Biometrika Office. 
Pearson, K. & Mout, M. (1925). Ann. Eugen., Lond.; 1, 1. 





[ 182 ] 


THE PROBABILITY INTEGRAL TRANSFORMATION WHEN 
PARAMETERS ARE ESTIMATED FROM THE SAMPLE 


By F. N. DAVID anp N. L. JOHNSON 


1. The probability integral transformation for testing goodness of fit and combining tests 
of significance was introduced by R. A. Fisher in 1932. Fisher’s objective was the significance 
of combined independent tests of significance, but his method also proved applicable to 
a certain limited range of tests for goodness of fit as can be seen in K. Pearson (1933), 
J. Neyman (1937) and E. 8S. Pearson (1938). The transformation may be summarized briefly 


in the following way. Assume that there is a continuous random variable x whose elementary 
probability law is p(x), whence obviously 


+. p(x) dx = 1. 


Consider a new random variable, y, connected with x by the relation 


y= |" playdr, 


—@ 


y is a monotonic non-decreasing function of z and 0< y< 1. Further, if p(y) is the elementary 
probability law of y, then 


d 
ply) = re) z= 1. 


Hence in the interval [0; 1] all values of y are equally likely, or in common parlance, y is 
rectangularly distributed in the interval [0; 1], no matter what the elementary probability 
law of x. If therefore we have n independent random variables x,(j = 1, 2, ...,) following 


a known continuous probability law which is completely specified by Hj, the hypothesis 
tested, then by means of the transformation 


xy 
y;= [ P(x; | Hy) dx;, 


the z’s can be transformed into m independent random variables y which are rectangularly 
distributed. 


2. The transformation which we have just summarized is useful statistically in that tests 
based on a rectangular population can be made applicable to any variable of which the 
elementary probability law is known. However, because the parameters of the elementary 
probability law must be specified, it is clear that the range of application of any tests based 
on this transformation will be very restricted, for cases are rare in statistical practice when 
H, is completely specified. It seemed interesting to us to investigate the effect on the trans- 
formation of calculating estimates of the parameters from the data provided by the sample. 
For example, if the mean of the probability law is estimated from a sample of n quantities 
X,,Xq,...,X,, each of which is one observed value of n random variables x,,%., ...,2,, the 
y’s obtained by the probability integral transformation will no longer be independent, 
neither will they be rectangularly distributed. We are able to show that the generality of 
the transformation in the case when the parameters are completely specified is lost as soon 
as we begin replacing unknown parameters by the sample estimates, and, as is intuitively 


obvious, the form of the probability law of y depends on the functional form of the common 
probability law of the z’s.° 
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3. We begin by stating the problem in a formal mathematical way and indicate the method 
whereby a general solution is reached. Assume that p(z) is a single valued continuous function 


of the form P(x) = f(x | A,, Oo, ...,9,), 


where, in the usual way, @,,0., ...,0,, are parameters descriptive of the population, all of 
which may or may not be specified. It may be assumed for generality that none are specified 


and that in place of the unknown parameters, @, it is necessary to substitute functions of the 
sample values, say, 


Fi Be ---sE—), Peleg. Sq ---:Zq), --+5° Fle: Sq---> Ze), 


where 2, 2%, ...,%,, are the random variables of which the n observations which form the 
sample are the observed values. Thus we require to find the distribution of the variables 


Yy;,= “StF, e---92,)0 for i= 1,2.,...,2. 


We have immediately that 
Ou. ‘ri ~ 8 8 OF [zx 
= <. of oF, tor oF, of Sf x 





——s 


eS Ox; r=1 OX; J — « OF, me th}, 


and f(z; | A, F, ..., B)+ 5 af, Err spt! for i=j. 


In matrix notation we may write this 


OY, ---Y, Yn) oF; of 
O(a, --+> Lp |- a+ 52] eh 


A, is a diagonal matrix with diagonal elements f(x, | /,, ..., F,).[0F;/éx,] is an n x s matrix, 





Pxy 


OF; /0x,, being the element in the kth row and the jth column. | = 


wi " nA dt being the element in the kth row and the jth column. The rank of the matrix 





-at| isan s x » matrix, 


E : n-ne) | is not immediately obvious. In general it may be noted that it will be at least 
O24, ..05 Lu 


n—s, and that it will be less than n. A study of particular cases leads us to believe that where 
the s sample estimates are algebraic functions each of the other, as for example, the sample 
moment coefficients, then there will be s independent relationships between the y’s, and the 
rank of the matrix will be n — s. Where the sample estimates are not functions of one another, 
as for example in the case of the median and the standard deviation, the matrix rank will 
be between n—s and n. We have not been able to prove this in general but it should not be 
impossible to do so. 

We shall assume that there are s independent relationships between the variables 
Yi, Yo: «++» Y,- Under this last assumption we have 


eee i“ o(F,, ---, ¥) 
Ay, ..»5 Hq) i ae Ze 


(provided partial differentiation is, in fact, possible), whence, since 





Th flee Fy» B) 


P(Xy, La, ---5Xpy | Oy, Og, ---, 95) = TL S| AO - utah, 
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the joint probability law of y,, ¥2, ---,Yn—s,%, ---, ¥, may be written 

n 

al | as acted O(F,, ---,F,) | 


PUY 1, Yes «++ Va—ar Ht» Ma» ---» Hj O,, Og, ...,9,) = =o — ax <i 
UT fle| FF 1B) eer 
i= 





Alternative expressions for the joint-probability law may be obtained by using the 
n-s 

relationship TI S (xg | 9, ---,,) = pay, ---1B qs | Oy, ---> 99). 
i=1 


Substituting in the right-hand side of the joint law we have 
P(Y rs Yas += Yn» Fs Pay «++ Fy | 4, Oa» «++» 9s) 


"—8 f(x, | 01, 0g, ..-, 9, : a...,4) {- 
. Ty | FF, a ae (5 | 15 Oa» «+» 9s) mo os 

m8 f (xi | 1, , ---, 9s) 
imi f(x; | 4, Fh, .--,F) 
— Play +++ Eng» Fy, Fy ++» Fy | Oy +++ 9s) 


n-—s 
Th fs | A, Fy -- #) 











GF, Boy --~» Be | Sp «+2 Be —0422 My» ---0 9) 





4, In the previous section formal solutions only of the problem have been set down. For 
any particular case the analysis becomes somewhat complicated. Accordingly, in order to 
obtain a clear idea of the kinds of distributions arising, we shall first confine ourselves to the 
discussion of («) the special case where only location and scale parameters appear in the 
probability law of the z’s and (f) the distribution of single y;. Under (f) we may note that 


ay 
yy; = [' S(t| A, A, ..., F) dt = 2,(x,, fF, ...,F), say. 


If the distribution of Z; is known, the distribution of y; may be found immediately, and in 
particular if we can write 


24 Xi, Fy, ..., F's) 
Y; = Z (2X; F,, sees F,) => } g(t) dt, 
then P(Y:) = (9(2))* plz). 


5. It is not uncommon in statistical practice to find probability laws which are completely 
specified by a single parameter for location and a single parameter for scale. The normal 
curve is, of course, the classic example. Let £ be the parameter of location, o the scale 

arameter, and write 
oe p(x) = f(x| £,0). 


x (m—-£)/o (m-Hlo 
If n-{ f(t|§,o)dt = { fit}, 1)at = | f(t)dt, say, 


then we may write x; 





me = $(Yy;)- 


C 


Either £, or 7, or both may be estimated from the observed values of the random variables x. 
We treat two distinct cases. 
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Case (i): « known and & estimated 
We first suppose that the scaling parameter is known but that it is necessary to estimate 


a central measure of location. Suppose this to be a function M(z,, 29, ...,2,) which may 
be written for brevity M(x). We have 


{aa— re 
v= | f(t| M(x), 0) dt = oe fit)at. (1) 
— M(x 
sO = <2) = $(yi). 
It follows that pei (y)] = 0, 
provided M satisfies the usual conditions for a measure of location.* In this case therefore 


O(y,, -- , bes Hs! 
Az, ..-,% 
formula obtained in §3, the joint-probability law of; A Fay ---2 Ba~a0% 


Il f(x; | g, c) 
PCY Yas «++> Yn—a X) = it. 


there is one relation between the y,’s and | is of rank n—1. Using the general 


The distribution of any individual y; is simp!y obtained. For, since 


{zi—- M(a)]/e 
ae [- f() dt, 


we have p(y;) = E (A oe (= a 


and if the distribution of x;— M(x) is known, the distribution of y; follows immediately. 
Case (ii): both § and o estimated 

Assume that is estimated as before by M(x,, %g, ...,x,) = M(x). Since now @ is also 
unknown, suppose that it is estimated from the sample values by a measure of dispersion, 





say D(a, %q, ...,%_) = D(z). 
We have ¥,= i f(t | M(x), D(x)) dt, 
and * Ba = $(y;) 


Provided D(x) is a function of the quantities «;— M(x) and satisfies the usual conditions for 
a measure of dispersion, the y,’s must now satisfy the two conditions, 


M[$(y)] =9; D{P(y)] = 1. 


The matrix Eanes is then of rank n — 2. The conditions are satisfied, for example, if 


ee 


M(x) =% and D(x) = (> Dd (x; -z)) . By an argument precisely similar,to that of 


case (i) we have that sind Ee im ae) P(E Ban) , 


* M(x, +4, 2.44, ...,%_+@) = M(x, 2q,,...,5%_) +; M(x, 2x, x, ...,X) = 2. 
T (i) D(z, +a, ype 19%_ ta) = D(x,, Xq) ---»%q)3 

(ii) D(x, 2, ...,.%) = 

(iii) D(ka,, kag, ..., ker,,) =| | D(atys qs -- ~ a 
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where 


t) dt. (2) 


—-@ 


° [xi— M(x)}/ D(z) 
n= | 


It is seen that y; is rectangularly distributed, i.e. p(y;) = 1, if and only if 


eet) - 2) 


This condition is not likely to be satisfied. 

For both cases (i) and (ii) it may be noted that p(y;) is the ratio of two probability laws 
with a transformation of variables given by (1) and (2) respectively, and that nezther of these 
two probability laws depends on & or on o. 


6. Example I. Let 


pt) = Taare exp| -3(“5") |= S180. 


and as in the previous section consider two cases. 
For case (i) there are many good statistical reasons for choosing 


M(x) = 
for the estimate of £ for this probability law. In the notation of §4 


a= 


and , "= *) = p(z,) = ‘AE n ee _ ney 
y oC aid Pp os | oa (27) n— 1 cp ~ 2(n “3 1) 


Applying the results of the nt section we shall have 











(y,) l n on nz" es af 
y;) ={- ex ——— /——ex exp| —~———— ], 
POs) = \ (2m) 5 n—1 ~ 3m—1) Pl ~2(m—1)] 

: (3) 
where z; = $(y;) is defined by 1 

¥: =~ | e— dt 
(27) J —« 

Clearly p(y;) has a maximum value ,/n/(m — 1) at z; = 0, ie. when y = $, and the probability 
law is symmetrical about this point. p(y;) is zero at the points y; = 0(z; = —0o) and 


y,; = 1(z; = +0). A graph of the function for three different values of » is given in Fig. 1 
In order to compare p(y;) with the rectangular distribution we may find the points at which 
the curve crosses it. This will be when p(y;) = 1 or when 


24 ] 
a Ee | eo Fe 
2(n—1) jog ( :) 


Expanding the logarithm as a series we have that 


1 1 


12n? 


22x] 
= 


i ~T eeey 


or, for n moderately large, z; is nearly equal to +1. It follows that p(y;) = 1 when 
y; == 0-159 or 0-841. 
In case (ii) for the same p(x), assume 


M(xz)=%, D(x)=8 











F. N. Davin anp N. L. Jounson 187 
(2) As before, write 2;,= a—, 
, 2 {n—4) ash = 
then (z;) = yn 1— = - 5 for i: 58 —: 
Pp t 1 9 . 1 2 vu 
n—1) B(S,"5*) a3 N yn 


It follows that 


1 —1 In nz? (n—4) 
| i — —}22 Vv l Bs co Ls 
AWS P(Yi) (- (27) ° 1 =) ae 






















































hese (n—1) B(5, 5) 
/ 
27 1 nzz \e-4s 
ar ( ) ; _— = ei", (4) 
n—1 Bi, 4m—2)\ (m—1 
; 
1+4 . a 
1 .: ip afiees = fon 4. 4. 4 
1-1 4 
; 1-0 4 
0:9 
0-8 | S 
= & 
= 0-77 Ge 
ms ) 
_*" r 3 0-6} 
© ¢ 
; 4 0-5 w O-5+ 
TD 0x4 
O-4F 
5 | : 0-3 03 
0-2 + 7 ° 
2 
(3) ag * | 
Ov} 4 
' O O-1 0-2 0:3 0-4 05 0-6 0-7 0°8 0-9 1°0 9 Ol 0-2 03 0-4 0-5 6 0-7 8 09 1-0 
lity Seale of y; Scale of y; 
and -—-—n=6 nm=1l ———n=21 n=6 ———n=l1l -—-—n=2]l 
g. 1. Fig. 1 Fig. 2 
hich 
Fig. 1. The probability integral transformation applied to the normal curve with estimated mean. 
( Fig. 2. The probability integral transformation applied to the normal curve with estimated 
! mean and standard deviation. 
1 +V(2+(1jn)] 
(ataxima approximately at y;= saa! e-t a.) 
V (27) J —a 
1 n ug? 
where, as before, Yi =D edt. 
\ V(27) J - 0 
when 


A graph of this function, for the same sample sizes considered in case (i), is given in Fig. 2. 
7. Example II. Let x be distributed as y* with two degrees of freedom, i.e. let 


p(x) = 5 =f(x|0) for x>0. 
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If we estimate 6 by’ M(x) = 3, 
i — - 
then ¥,=- I e-lz dt = 1 —e-*Wz, 
ZJo 
In this case we know, writing u,; = %,/2, 
= n—2 
that p(u,) = — = (1 - “4 (0<u,;<n). 
Following the procedure of the previous sec- ee Ee : sae 
tions, we have that 12 
n—-1 1 i n—2 1-1} 
Dep Segal apes Fd | io. 
PY) = =] —[) += log ( uv) i: 
for 0<y;,<1l-e™. (5) 0-9 
A graph of this function is given in Fig.3. - o-sf 
8. The joint-probability law of the y,’s for = 0-7} 
Example I of §6 follows from an application ‘% ae | 
of §3. If we are considering a normal distri- 4 
bution and if M(x) = % then a 
0-44 4 
=¢" F -- *). 0-3} 1 
‘ 0-2+ 4 


Since the quantities x;— Z% are independent of 
% it follows that the y’s are also independent Of 
of %. The most convenient formuia to use 
would seem to be 











Oo D1 02 03 04 05 06 07 08 09 10 








Scale of y; 
PUYts +s Yn» 2 | E,0) = Pon =? 160) n=6 ———a”n=ll -—-—n=2]l 
i fe , | “ms Fig. 3. The probability integral transforma- 
jn-1 l tion applied to the law 
Since z= niet Up+7 Lp ners : oa 


> 


1 £ Ae. 
and Hes tna >. ote.) —E= ie being estimated from the data. (The maximum 
- * n nm is at 1—e-2=0-865 whatever be n.) 


it is clear that 


P(F | x4, ..-,%__3,6,0) = Taya? | 35i| @ )- = E te, -»)| . 


Hence 
ra n i —s 
P(X, --+»Lp_y,%|E,0) = Caan? -asal ( (a, —£)?+ +| @- £)— = (x -»| \), 
a n—1 e Pr 1 ] 2-1 oe 
an LI S(@ | 2,0) = Gamara?| a3 (x; —%) } 


The joint-probability law of y,, yo, ..., y,—-; and Z will be 
SG tw anbiecaial clehaaiect Gm. at 
PUY ys -++> Yn—a % | §; ) = Tarya*P( — 358 n(% —£)* + 2 (x;-—Z) 


= “i —exp [ - ae — SY exp [- 13 avo} | 
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¢(y;) being defined as in (1). Integrate out for Z, and we have 


1(z-1 
PUY» --»Yo-1|60) = Ynexp| - 31'S $v} ]. (6) 
It will be noted that this joint probability law is independent of both & and oc. 


9. The exponential law discussed in §7 differs from the examples in which the normal law 
was used in that in this particular example a measure of location is used to estimate a scale 
parameter. We have l 
p(x) ea go 





h 4 he 12-1 1 
whence, since f= ned t+o tw 
si ™" n af_ 19%! 
it is seen that p(% | #4, ..-,%__y,0) ==exp| —z=| Z-- DO 2, ]}, 

0 0 Ni=l 

n—1 
1 2% 

and also Pa, Le, ---»%y_, | 9) = gan exP \ — “ “ 


It follows that 








n—1 
n—1 a 1 2 v; 
and i f(x; |%) = =n XP \ -—=—} - 





n—1 
z\"- = w% 
= n (z\"— az 2 * 
Pls tv? 10) = 2(5) o(-|2-4 )) 


Remembering that —— x 


the joint-probability law may be rewritten 
He n (z\"—1 1 
P(Ya» +++ Yn—1» | 9) = G (5) dis nes 


n—1 n—1 
where II [—log(l-y,)]<n or [][ (l-y,)<e™. 
i=1 i=1 


Integrating out with respect to , 


’ n—1)! 1 a1 
PY» teal) =F —— Ty se 7) 


Ta-y) 
t=1 





again a result which is independent of the parameter of the probability law. 


10. The results of this investigation, which we have carried out partly in the general and 
partly in the particular, are obviously incomplete ‘and should be succeeded by a fuller 
inquiry which would clear up the doubtful points which we have had to pass over, and 
possibly extend the general theory a little further. We feel that none of the questions which 
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have been raised in the course of this inquiry are insoluble by algebraic analysis but it is 
uncertain whether it is profitable to proceed with the fuller inquiry until some of the 
statistical implications of what has been done become more clear. For example, we have 
noted that given n independent random variables, x, if s sample moments are calculated 
from them and used as estimates of the parameters of the probability law, then it appears 
that there will be s independent relationships between the y’s. Thus in this case the 
point ¥;, Ys, ---,¥, is constrained to move in an n—s dimensioned space within an » dimen- 
sioned cube, and we have the exact analogue to the loss of degrees of freedom with x? when 
the parameters have to be estimated from the data. What is not clear is how the y’s are 
constrained when the sample estimates of the parameters are not the sample moments, and 
while this situation may not often be met with in practice, yet it should be explored. 

When the parameters of location and scale are estimated from the data it is clear that the 
distribution of any individual y,;, and the joint-probability law of the y’s also, will not be 
dependent on these unknown parameters of the probability law of the x’s, but will depend 
on the functional form of that law. This result appears capable of extension for the case 
when higher sample moments are also used for estimating parameters. This being so, there 
would seem to be two ways in which the joint probability law of the y’s may be utilized in 
statistical applications. First, it should be possible mathematically to form certain broad 
classes of functions for each of which the joint-probability laws of the y’s would be approxi- 
mately the same, or second one may seek for some transformation of variables so that 
instead of the correlated y; we obtain n—s new independent variables following some 
distributions which are independent of the original p(x). Both these methods of attack 
may lead to results which will only be valid for large samples, but provided the results in 
either case have sufficient algebraic simplicity they should make possible certain generaliza- 
tions in statistical analysis of which Neyman’s ‘smooth’ test for goodness of fit is only one 
important example. 
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A TABLE FOR THE CALCULATION OF WORKING PROBITS 
AND WEIGHTS IN PROBIT ANALYSIS 


By D. J. FINNEY (Lecturer in the Design and Analysis of Scientific Experiment, 
University of Oxford) anp W. L. STEVENS (Admiraliy) 


The estimation of the parameters of a distribution of individual tolerances, from data 
relating to numbers of subjects manifesting a characteristic quantal response at different 
levels of a stimulus, is a problem frequently encountered in the application of statistical 
science to dose-mortality studies, biological assay, detonation of explosives, and other 
problems. A typical situation is that of exposing batches of insects to various doses of an 
insecticide, recording the proportion killed at each level of dose and then requiring to 
estimate the mean tolerance (or median lethal dose) of individual insects and the variance 
of the tolerance distribution. Gaddum (1933) and Bliss (1935@, 6; 1938) have been inséru- 
mental in developing a method, that of the probit transformation, which greatly simplifies 
the calculations necessary to the estimation. The exact statistical analysis appropriate to 
the transformation was first shown by Fisher (1935), and the theory and uses of the method 
have been discussed fully in many subsequent publications (Finney, 1947a, 6). 

Tables required in the practice of the method, in sufficient detail for most purposes, have 
been given by various writers (Fisher & Yates, 1943; Finney, 1947a). Occasionally, however, 
the statistician needs values of the various functions at finer intervals of the argument, and 
for his benefit the following Table has been prepared. A brief account of the tabulated 
functions will suffice for all who are familiar with the probit method; those who require 
fuller information on the theory and analysis should consult the list of References. 

Given a proportion P, and its complement Q = 1 — P, the probit of P is, to all intents and 
purposes, the deviate from the mean which divides the normal curve of unit variance in the 
ratio P:Q. In the formal definition, however, 5 is added to the deviate in order to avoid the 
necessity of computing with negative numbers. The advantage of this modification may be 
questioned, but it is now well established and will be adopted here. The probit, Y, of the 
proportion P is thus defined by 

1 frY-5 
= | et? du. 
(27) J — © 


The standard method of analysis makes use of the maximum and minimum working probits, 


, . 
Yinex. =} +7 
a 
and Youn, = I —F: 
and also of the range, 1/Z, 
l en | 
where 7, = —___ K-53". 
V(27) 
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If n subjects receive the same stimulus, and r of them show the characteristic response, 
the empirical value for the proportion responding is 


p=1/n; 
the complement of this is denoted by g = 1—p. The probits of a set of values of p should 
be approximately linearly related to x, the measure of the stimulus, and a line fitted by eye 


may be used to give a corresponding set of expected probits, Y.'The working probit corre- 
sponding to each proportion is next calculated, from either 


y= Y+Q/Z—q/Z, 
or y= Y-P/Z+p/Z, 
using tabulated values of the maximum or the minimum working probit (whichever is the 
more convenient) and the range. An improved set of expected probits is then derived from 


the weighted linear regression equation of working probits on x, each y being assigned 
a weight, nw, where the weighting coefficient, w, is defined as 


w= Z?/PQ. 


The process may be repeated with the new set of Y values. The iteration converges to give 
a linear regression equation which is an estimate of 


where 1 is the mean and o the standard deviation-of the tolerance distribution. The method 
depends upon an assumption that the stimulus is measured on a scale for which individual 
tolerances are normally distributed: often the logarithm of ‘dose’ rather than dose itself 
is taken as 2, in order to satisfy this condition more closely. 

The Table which follows gives Y,,,, for Y = 3-58(0-01) 9-00, Yin for Y = 1-00(0-01) 
6-42, 1/Z and w for Y = 1-00(0-01) 9-00, all to four pleces of decimals. Below Y = 3-58, 
Ymax, exceeds 10-00, and above Y = 6-52, Y,,,, is negative; it is then almost always more 
convenient to calculate working probits from the other function, but the function not 
tabulated can easily be obtained from the relationship 


Yinax. oe Youn. = 1/2. 

Between 3-58 and 6-42 both functions are tabulated. In order to save space the Table is 
arranged in parallel forward- and backward-reading columns; for the arguments Y and 
(10— Y) values of 1/Z and w are the same, and simple relations exist between Y,,, and 
Yinin.- All entries have been calculated to six or more places of decimals and rounded to four, 
except that w between Y = 2-7 and Y = 7-3 was obtained by collating two existing tables 
and checking discrepancies. 

The values of P and Z, from which the present Table has been calculated, were taken 
from Tables of the Probability Function, Vol. 1 (1942), published by the Federal Works 
Project Administration for the City of New York. Values of Q/Z have been taken from, or 


checked against, W. F. Sheppard’s table, published as The Probability Integral (1939), 
Vol. vii of the British Association Mathematical Tables. 


Example 


In a batch of 281 insects receiving the same dose of insecticide, 119 are killed. The provi- 
sional probit regression line gives an expected probit of 4-61 for this dose; find the working 
probit and the weight to be attached to the observation. 
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nse, ; 
Maximum Minimum re 
— working working Range pie ses. 
- Y , probit probit 1/Z Zn — 
¥+Q/z | Y-P/z /PQ 
yuld 
eye 5-00 6-2533 3-7467 2-5066 0-6366 6-2533 3-7467 5:00 y 
rre- f 01 +2534 -7466 -5068 -6366 +2534 -7466 4:99 
02 +2536 -7465 -5071 -6365 2535 -7464 798 
-03 -2539 -7461 -5078 6364 -2539 -7461 -97 
-04 -2543 --7457 -5086 -6362 -2543 -7457 -96 
5-05 6-2548 3-7450 2-5098 0-6360 6-2550 3-7452 4-95 
-06 +2555 7444 5111 6358 2556 . 7445 -94 
-07 +2563 7435 -5128 6355 -2565 -7437 -93 
the -08 -2572 -7425 -5147 6351 +2575 -7428 -92 
— ’ 09 -2582 -7414 -5168 *6347 -2586 -7418 91. 
eal 5-10 | 62593 3-7401 2-5192 0-6343 6-2599 3-7407 4-90 
“il +2605 -7387 -5218- -6338 -2613 -7395 -89 
“12 -2618 -7371 5247 -6333 2629 7382 -88 
13 -2632 7353 5279 -6327 “2647 7368 -87 
-14 +2647 -7334 -5313 -6321 +2666 -7353 86 
give 5-15 6-2664 3-7314 2-5350 0-6314 6-2686 3-7336 4-85 
) “16 -2681 -7292 5389 -6307 -2708 7319 84 
“17 +2699 -7268 5431 6300 -2732 -7301 83 
-18 -2718 7242 5476 | -6292 -2758 -7282 82 
-19 -2738 7215 5523 | -6283 -2785 -7262 81 
‘hod 5-20 6-2759 3-7186 2-5573 0-6274 6-2814 3-7241 4-80 
21 -2781 -7156 5625 -6265 2844 -7219 -79 
dual -22 -2804 -7124 -5680 6255 -2876 7196 -78 
tself ' -23 -2828 -7090 -5738 6245 -2910 -7172 77 
} -24 +2853 -7054 “5799 6234 -2946 7147 -76 
5-25 6-2878 3-7016 2-5862 0-6223 62984 3-7122 4-75 
01) 26 +2905 -6977 -5928 6211 -3023 7095 74 
3-58, 27 +2932 6935 -5997 -6199 -3065 -7068 73. 
-28 -2960 -6892 -6068 -6187 -3108 -7040 72 
nore -29 -2989 -6846 -6143 -6174 +3154 -7011 “71 
not 5-30 6-3018 3-6798 2-6220 0-6161 6-3202 3-6982 4-70 
31 +3049 6749 -6300 6147 +3251 6951 69 
32 -3080 6697 -6383 6133 -3303 -6920 -68 
' -33 -3112 6643 6469 6119 +3357 -6888 -67 
ei 34 +3145 6587 6558 6104 -3413 6855 66 
sen 5-35 6-3178 3-6528 2-6650 0-6088 63472 36822 4-65 
and -36 +3213 -6469 +6744 -6072 +3531 “6787 64 
oni 37 -3248 6406 6842 6056 -3594 6752 63 
-38 -3283 6340 6943 -6040 -3660 6717 62 
four, -39 -3320 -6273 7047 -6023 +3727 +6680 61 
ables ; 5-40 6°3357 3-6203 2-7154 0-6005 63797 3-6643 4-60 
41 -3394 6130 -7264 -5987 +3870 -6606 -59 
-42 +3433 6055 -7378 -5969 3945 6567 58 
aken -43 +3472 -5978 -7494 -5951 -4022 6528 -57 
forks -44 +3512 -5898 -7614 -5932 -4102 6488 56 
<n 5-45 6°3552 3-5815 27737 0-5912 6-4185 3-6448 4-55 
. -46 -3593 -5729 -7864 -5893 -4271 6407 54 
939), 47 +3635 -5641 -7994 5872 -4359 6365 -53 
-48 -3677 “5550 -8127 5852 -4450 -6323 52 
-49 -3720 5456 8264 5831 4544 6280 51 
5-50 6-3764 3-5360 2-8404 0-5810 6-4640 3-6236 4-50 
ad Y¥+Q/Z Y-P/Z Y 
° + _— 
rking | WZ ace Maximum | Minimum |E t 
A Range colunet working working probit 
; probit probit 
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Table of working probits 









































Maximum | Minimum Weighting 
— working working Range coefficient 
“y probit probit 1/Z Z*/PQ 
Y+Q/Z Y-P/Z 
5-50 6-3764 3-5360 2-8404 0-5810 6-46490 3-6236 4-50 
51 +3808 -5260 *8548 -5788 -4740 -6192 -49 
*52 +3852 -5157 *8695 -5766 +4843 -6148 -48 
-53 +3898 +5052 *8846 -5744 -4948 -6102 -47 
+54 +3944 +4943 -9001 +5722 -5057 -6056 -46 
5-55 6-3990 3-4831 2-9159 0-5699 6-5169 3-6010 4-45 
-56 +4037 -4715 *9322 -5675 +5285 +5963 -44 
*57 -4085 -4597 *9488 -5652 +5403 -5915 -43 
-58 -4133 -4475 -9658 -5628 *5525 -5867 42. 
59 -4181 +4349 -9832 +5603 -5651 +5819 41 
5-60 6-4230 3-4220 3-0010 0-5579 6-5780 3°5770 4-40 
‘61 +4280 -4088 -0192 -5554 -5912 -5720 39 
62 ' +4330 +3952 -0378 -5529 -6048 +5670 38 
63 -4381 +3812 -0569 -5503 -6188 -5619 37 
64 +4432 *3669 -0763 *5477 -6331 +5568 36 
5-65 6-4484 3-3522 3-0962 0-5451 6-6478 3-5516 4-35 
*66 +4536 +3370 -11°6 +5425 -6630 -5464 34 
*67 -4588 +3214 *1374 +5398 -6786 +5412 +33 
68 -4641 +3055 -1586 *5371 -6945 +5359 +32 
69 -4695 +2892 +1803 +5343 -7108 +5305 31 
5-70 6-4749 3°2724 3°2025 0-5316 6-7276 3°5251 4-30 
“71 -4803 +2551 *2252 *5288 -7449 +5197 ‘29 
‘72 -4858 +2375 +2483 +5260 -7625 +5142 +28 
‘73 -4914 +2194 +2720 +5232 -7806 +5086 ‘27 
‘74 -4969 *2008 *2961 +5203 -7992 +5031 26 
5-75 6-5026 3°1819 3°3207 0-5174 6-8181 3-4974 4-25 
‘76 “6082 -1623 +3459 *5145 *8377 -4918 “24 
‘77 +5139 +1423 716 -5116 *8577 -4861 23 
‘78 *5197 +1219 +3978 -5086 *8781 -4803 ‘22 
‘79 -5255 -1009 -4246 -5056 *8991. -4745 21 
5-80 6-5313 3-0794 34519 0-5026 6-9206 3-4687 4-20 
‘81 +5372 -0574 -4798 -4996 *9426 -4628 19 
+82 -5431 -0348 -5083 -4965 -9652 -4569 18 
+83 +5490 -0116 +5374 -4935 *9884 -4510 17 
+84 -5550 2-9880 -5670 -4904 7-0120 -4450 16 
5-85 6-5611 2-9638 35973 0-4873 7-0362 3-4389 4-15 
86 *567T -9389 -6282 -4841 -0611 -4329 14 
87 *5732 *9135 *6597 -4810 -0865 -4268 “13 
-88 +5794 +8875 -6919 -4778 +1125 +4206 12 
“89 +5855 -8608 “7247 -4746 +1392 -4145 ‘11 
5-90 6-5917 2-8335 3-7582 0-4714 7-1665 3-4083 4:10 
‘91 +5980 -8056 “7924 -4682 +1944 -4020 09 
-92 -6043 ‘7771 *8272 -4650 +2229 +3957 ‘08 
+93 -6106 -7478 -8628 -4617 +2522 +3894 ‘07 
+94 -6169 *7178 -8991 -4585 +2822 +3831 06 
5-95 6-6233 2-6872 3°9361 0-4558 7-3128 3°3767 4-05 
-96 *6297 *6558 -9739 -4519 +3442 +3703 -04 
‘97 -6362 -6238 40124 -4486 +3762 +3638 -03 
‘98 *6426 +5909 *0517 -4453 -4091 +3574 02 
-99 -6491 +5573 -0918 +4420 4427 +3509 ‘01 
6-00 6-6557 2-5230 4-1327 0-4386 7-4770 3°3443 4-00 
Y+Q/Z Y-P/Z 
Z*/PQ , we ¥ 
1/Z Weichti Maximum | Minimum E ted 
Range med working working eee 
coefficient probit probit probit 
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Maximum | Minimum a ig 
Expected working working Range Weighting 
probit robit robit /Z coefficient 
Y 3 P Z*/PQ 
+Q/Z Y-P/Z 
6-00 66557 2-5230 4-1327 0-4386 7-4770 3-3443 4-00 
-01 -6623 -4878 -1745 -4353 +5122 +3377 3-99 
-02 -6689 -4518 *2171 -4319 -5482 *3311 -98 
-03 -6755 -4150 -2605 -4285 -5850 +3245 -97 
-04 -6822 +3774 +3048 -4252 -6226 “3178 -96 
6-05 6-6888 2-3387 4-3501 0-4218 7-6613 3-3112 3-95 
-06 -6956 “2994 +3962 -4184 -7006 -3044 94 
-07 -7023 +2590 +4433 -4150 -7410 +2977 -93 
-08 -7091 +2178 -4913 -4116 -7822 +2909 -92 
“09 -7159 -1756 -5403 -4082 -8244 +2841 -91 
6-10 6-7227 2-1324 4-5903 0-4047 7-8676 3-2773 3-90 
| 7296 -0883 -6413 -4013 -9117 +2704 89 
12 7365 +0432 -6933 -3979 -9568 +2635 88 
13 7434 1-9970 -7464 +3944 8-0030 -2566 -87 
14 7504 -9498 -8006 +3910 -0502 +2496 86 
6-15 6-7573 1-9014 4-8559 0-3876 8-0986 3-2427 3-85 
*16 7643 *8520 -9123 +3841 -1480 +2357 “84 
17 -7714 -8016 -9698 -3807 -1984 -2286 *83 
18 7784 -7498 5-0286 *3772 +2502 +2216 82 
19 *7855 -6970 -0885 +3738 +3030 +2145 “81 
6-20 6-7926 1-6429 5-1497 0-3703 8-3571 3-2074 3-80 
21 *7997 -5876 -2121 +3669 -4124 -2003 -79 
22 -8068 -5310 +2758 +3634 -4690 +1932 -78 
23 *8140 -4731 +3409 +3600 -5269 -1860 ‘77 
24 *8212 -4140 -4072 +3565 -5860 -1788 *76 
6-25 6-8284 1-3534 5-4750 0-3531 8-6466 3-1716 3-75 
+26 +8357 +2916 -5441 +3496 -7084 -1643 “74 
27 -8429 +2282 -6147 +3462 -7718 *1571 -73 
28 -8502 +1635 -6867 +3428 *8365 -1498 -72 
29 +8575 -0972 -7603 +3393 -9028 +1425 “71 
6-30 6-8649 1-0295 5°8354 0-3359 8-9705 3-1351 3-70 
31 *8722 0-9602 -9120 +3325 9-0398 +1278 69 
+32 -8796 *8893 -9903 -3291 -1107 +1204 -68 
33 -8870 -8168 6-0702 +3256 +1832 +1130 67 
+34 *8944 -7426 -1518 -3222 +2574 -1056 -66 
6-35 6-9019 0-6668 6-2351 0-3188 9-3332 3-0981 3-65 
+36 *9093 -5892 +3201 *3155 -4108 -0907 -64 
+37 “9168 -5098 -4070 *3121 -4902 -0832 -63 
+38 *9243 -4286 *4957 -3087 -5714 -0757 -62 
+39 -9318 +3455 -5863 +3053 -6545 -0682 61 
6-40 6-9394 0-2606 6-6788 0-3020 9-7394 3-0606 3-60 
-41 -9469 -1736 *7733 -2986 *8264 -0531 -59 
-42 *9545 -0847 -8698 +2953 *9153 -0455 -58 
-43 -9621 *9684 +2920 -0379 57 
“44 -9697 7-0691 +2887 -0303 -56 
6-45 6-9774 7-1720 0-2854 3-0226 3-55 
-46 -9850 *2771 *2821 -0150 54 
-47 6-9927 -3845 +2788 -0073 +53 
-48 7-0004 -4943 +2756 2-9996 +52 
49 -0081 -6064° +2723 -9919 51 
6-50 7-0158 7-7210 0-2691 2-9842 3-50 
Y+Q/Z Y-—P/Z 
Z*/PQ ‘ ae Y 
1/Z bag Py. Maximum | Minimum 
Range come working working Pay 
probit probit P 
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Table of working probits 





























Maximum we 
Expected > Weighting 
probit working Range coefficient 
Y probit 1/Z Z3/PQ 
¥+Q/Z 
6-50 7-0158 7-7210 0-2691 2-9842 3-50 
51 -0236 +8380 +2658 -9764 49 
52 -0313 *9577 +2626 *9687 -48 
-53 -0391 8-0800 +2594 -9609 *47 
“54 -0469 +2050 +2563 *9531 -46 
6°55 77-0547 8-3327 0-2531 2-9453 3-45 
-56 -0625 -4633 +2500 “9375 Ad 
-57 -0704 +5968 +2468 -9296 -43 
-58 -0783 *7333 +2437 *9217 -42 
-59 -0861 *8728 +2406 “9138 41 
6-60 7-0940 9-0154 0-2375 2-9060 3-40 
-61 -1020 -1613 +2345 -8980 +39 
62 -1099 +3105 +2314 -8901 +38 
63 +1178 *4630 +2284 +8822 37 
-64 +1258 -6190 *2254 *8742 +36 
6-65 7-1338 9-7785 0-2224 2-8662 3-35 
-66 *1417 -9417 +2194 *8583 +34 
67 -1498 10-1086 -2165 +8502 +33 
-68 -1578 10-2794 +2135 *8422 *32 
69 +1658 10-4540 +2106 +8342 31 
6-70 7-1739 10-6327 0-2077 2-8261 3-30 
“71 -1819 10-8156 +2049 *8181 “29 
-72 -1900 11-0027 +2020 *8100 +28 
‘73 -1981 11-1941 -1992 -8019 *27 
“74 +2062 11-3900 +1964 *7938 +26 
6-75 7-2143 11-5905 0-1936 27857 3-25 
‘76 +2224 11-7957 -1908 *71776 24 
°77 +2306 12-0058 -1881 *7694 +23 
‘78 +2387 12-2208 -1853 -7613 *22 
‘79 -2469 12-4409 +1826 *7531 21 
6-80 7-2551 12-6662 0-1799 2-7449 3-20 
81 -2633 12-8969 -1773 “7367 19 
*82 *2715 13-1331 +1746 *7285 18 
-83 +2797 13-3750 +1720 -7203 17 
“84 +2880 13-6227 +1694 -7120 16 
6°85 7-2962 13-8764 0-1669 2-7038 3-15 
-86 *3045 14-1362 +1643 *6955 14 
*87 -3128 14-4023 -1618 6872 13 
-88 +3210 14-6749 +1593 -6790 “12 
“89 +3293 14-9541 -1568 -6707 ‘ll 
6-90 7-3376 15-2402 0-1544 2-6624 3-10 
‘91 -3460 15-5333 +1519 -6540 ‘09 
*92 +3543 15-8337 *1495 -6457 ‘08 
-93 +3626 16-1414 -1471 *6374 ‘07 
94 -3710 16-4568 +1448 -6290 06 
6-95 73794 16-7800 01424 2-6206 3-05 
-96 +3877 17-1113 *1401 *6123 ‘04 
‘97 -3961 17-4509 -1378 -6039 ‘03 
“98 -4045 17-7989 -1356 -5955 ‘02 
99 -4129 18-1558 +1333 -5871 01 
7-00 7-4214 18-5216 0-1311 2-5786 3-00 
Y-—P/Z 
1/Z Z*/PQ Minimum . ¥ 
Range Weighting Guiiten Expected 
, coefficient - probit 
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Maximum 














Expected 4 Weighting 
probit working culdisieas 
Yy probit 1/Z Z2/PQ 
Y+Q/Z f 
7-00 7-4214 18-5216 0-1311 2-5786 3-00 
01 -4298 18-8967 -1289 -5702 2-99 
-02 -4382 19-2814 -1268 -5618 -98 
-03 -4467 19-6758 -1246 -5533 -97 
-04 -4552 20-0803 -1225 +5448 -96 
7-05 7-4636 20-4952 0-1204 2-5364 2-95 
-06 -4721 20-9207 -1183 *5279 +94 
-07 -4806 21-3572 -1163 -5194 -93 
-08 -4891 21-8050 -1142 -5109 -92 
-09 -4976 22-2644 -1122 “5024 -91 
7-10 7-5062 22-7357 0-1103 2-4938 2-90 
“11 -5147 23-2194 -1083 -4853 -89 
“12 +5232 23-7157 -1064 -4768 -88 
13 -5318 24-2251 1045 -4682 | 87 
14 +5404 24-7478 -1026 -4596 -86 
7-15 7-5489 25-2844 0-1007 2-4511 2-85 
16 +5575 25-8352 -0989 -4425 +84 
17 -5661 26-4006 -0971 -4339 -83 
18 +5747 26-9812 -0953 -4253 82 
-19 -5833 27-5772 -0935 -4167 81 
7-20 7-5919 28-1892 0-0918 2-4081 2-80 
21 -6006 28-8177 -0901 -3994 -79 
+22 -6092 29-4631 -0884 -3908 -78 
-23 -6178 30-1260 -0867 +3822 °77 
-24 +6265 30-8069 “0851 *3735 -76 
7-25 7-6351 31-5063 0-0834 2-3649 2-75 
-26 -6438 32-2249 -0818 -3562 “74 
27 *6525 32-9631 -0802 +3475 -73 
-28 -6612 33-7216 -0787 +3388 -72 
-29 -6699 34-5010 -0771 -3301 “71 
7-30 7-6786 35-3020 0-0756 2-3214 2-70 
31 -6873 36-1251 -0741 -3127 -69 
+32 -6960 36-9712 -0727 -3040 -68 
+33 -7047 37-8408 -0712 +2953 67 
+34 °7135 38-7348 -0698 *2865 -66 
7-35 7-7222 39-6539 0-0684 2-2778 2-65 
-36 -7310 40-5988 -0671 -2690 -64 
+37 *7397 41-5704 -0656 -2603 63 
-38 *7485 42-5695 -0643 +2515 “62 
-39 *7573 43-5970 -0630 +2427 61 
7-40 7-7661 44-6538 0-0617 2-2339 2-60 
-41 -7748 45-7407 -0604 *2252 -59 
42 -7836 46-8588 -0591 -2164 -58 
-43 *7924 48-0090 “0579 -2076 -57 
+44 -8013 49-1924 -0567 +1987 -56 
7-45 7-8101 50-4099 0-0555 2-1899 2-55 
-46 *8189 51-6628 -0543 -1811 54 
-47 *8277 52-9521 -0532 -1723 -53 
-48 -8366 54-2791: -0520 -1634 -52 
-49 *8454 55-6448 -0509 +1546 51 
7-50 7-8543 57-0506 0-0498 2-1457 2-50 
Y-P/Z 
Z/PQ ihe 4 
us Weighting Minturn Expected 
Range coefficient prey probit 
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Table of working probits 























Expected ear ay Weighting 
probit * coefficient 
Y probit 1/Z Z2/PQ 
Y+Q/Z 
7-50 7°8543 57-0506 0-0498 2-1457 2-50 
5) *8631 58-4978 -0487 -1369 -49 
+52 -8720 59-9876 -0476 -1280 -48 
-53 -8809 61-5216 -0466 -1191 -47 
54 -8897 63-1011 -0456 -1103 46 
7-55 7-8986 64-7277 0-0446 2-1014 2-45 
-56 -9075 66-4028 -0436 -0925 “44 
*57 -9164 68-1280 -0426 -0836 -43 
+58 -9253 69-9051 -0416 -0747 -42 
-59 -9342 71-7357 -0407 -0658 -41 
7-60 7-9432 73-6216 0-0398 2-0568 2-40 
61 -9521 75-5646 -0389 -0479 +39 
62 -9610 77-5667 -0380 -0390 +38 
63 -9700 79-6298 -0371 -0300 -37 
64 -9789 81-7559 -0362 -0211 +36 
7-65 7-9879 83-9472 0-0354 2-0121 2-35 
-66 -9968 86-2059 -0346 a2 34 
*67 8-0058 88-5342 0338 1-9942 +33 
-68 -0147 90-9344 -0330 *9853 +32 
69 -0237 93-4091 -0322 -9763 31 
7-70 8-0327 95-9607 ‘0-0314 1-9673 2-30 
“71 -0417 98-5918 -0307 -9583 29 
‘72 -0507 101-3053 -0300 *9493 -28 
‘73 -0597 104-1038 -0292 -9403 ‘27 
“74 -0687 106-9903 +0285 -9313 +26 
7-75 8-0777 109-9679 0-0278 1-9223 2-25 
-76 -0867 113-0396 -0272 -9133 -24 
77 -0957 116-2088 -0265 -9043 +23 
‘78 +1047 119-4788 -0258 -8953 -22 
-79 -1138 122-8530 -0252 -8862 21 
7-80 8-1228 126-3352 0-0246 1-8772 2-20 
-81 -1318 129-9290 -0240 -8682 19 
-82 -1409 133-6385 -0234 *8591 18 
-83 -1499 137-4676 0228 *8501 17 
*84 +1590 141-4206 -0222 -8410 *16 
7-85 8-1681 145-5018 0-0217 1-8319 2-15 
*B6 ‘1771 149-7158 -0211 +8229 -14 
87 -1862 154-0671 -0206 -8138 13 
-88 -1953 158-5609 -0200 -8047 12 
‘89 -2044 163-2020 “0195 -7956 “11 
7-90 8-2134 167-9957 0-0190 1-7866 2-10 
91 +2225 172-9476 “0185 “71775 09 
92 -2316 178-0632 0181 7684 08 | 
-93 +2407 183-3485 -0176 *7593 ‘07 
-94 +2498 188-8095 ‘O171 -7502 -06 
7-95 8-2590 194-4526 0-0167 1-7410 2-05 
96 -2681 200-2844 -0162 ‘7319 -04 
‘97 +2772 206-3118 -0158 +7228 -03 
‘98 +2863 212-5418 -0154 *7137 02 
99 +2955 218-9818 -0150 *7045 01 
8-00 8-3046 225-6395 0-0146 1-6954 2-00 
Y-P/Z 
1/Z 7 / PQ Minimum . 
eighting : Expected 
Range coefficient working robit 
probit P 
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Expected “ae Weighting 
probit schis WZ coefficient 
y Pp / Z/PQ 
Y+Q/Z 
8-00 8-3046 225-6395 C-0146 1-6954 2-00 
01 +3137 232-5229 -0142 -6863 1-99 
-02 +3229 239-6402 -0138 -6771 -98 
-03 +3320 247-0000 -0134 -6680 ‘97 
-04 +3412 254-6114 -0131 -6588 -96 
8-05 8-3503 262-4836 0-0127 *1-6497 1-95 
-06 +3595 270-6262 -0124 -6405 -94 
-07 +3687 279-0493 -0120 -6313 -93 
-08 +3778 287-7634 ‘0117 -6222 -92 
09 +3870 296-7792 “0114 -6130 ‘91 
8-10 8-3962 306-1082 0-0110 1-6038 1-90 
‘11 -4054 315-7619 -0107 -5946 “89 
12 -4146 325-7527 -0104 -5854 88 
13 +4238 336-0932 -0101 -5762 -87 
14 -4330 346-7966 -0099 -5670 -86 
8-15 8-4422 357-8732 0-0096 1-5578 1-85 
16 -4514 369-3477 -0093 +5486 84 
17 -4606 381-2245 -0090 +5394 “83 
18 -4698 393-5226 -0088 +5302 “82 
19 -4790 406-2580 -0085 +5210 81 
8-20 8-4882 419-4476 0-0083 1-5118 1-80 
21 -4974 433-1086 -0080 -5026 “79 
*22 -5067 447-2593 -0078 -4933 -78 
*23 -5159 461-9185 -0076 -4841 ‘77 
+24 “§251 477-1059 -0074 -4749 -76 
8-25 8-5344 492-8419 0-0071 1-4656 1-75 
26 +5436 509-1479 -0069 -4564 “74 
‘27 “5529 526-0459 -0067 -4471 *73 
28 -6621 543-5592 -0065 -4379 -72 
29 -5714 561-7116 -0063 +4286 ‘71 
8-30 8-5806 580-5283 0-0061 1-4194 1-70 
31 -5899 600-0353 -0060 -4101 69 
+32 -5992 620-2599 -0058 -4008 68 
+33 ' -6084 641-2302 -0056 *3916 67 
+34 *6177 662-9758 -0054 +3823 66 
8-35 8-6270 685-5274 0-0053 1-3730 1-65 
+36 -6363 708-9171 -0051 -3637 64 
+37 -6456 733-1780 -0050 +3544 63 
+38 -6548 758-3451 -0048 +3452 62 
39 6641 784-4545 -0047 +3359 61 
8-40 8-6734 811-5439 0-0045 1-3266 1-60 
41 *6827 839-6528 “0044 +3173 59 
-42 -6920 868-8222 -0042 +3080 -58 
-43 -7013 899-0948 -0041 +2987 -57 
44 -7106 930-5153 -0040 +2894 -56 
8-45 8-7200 963-1301 0-0038 1-2800 1-55 
-46 *7293 996-9878 -0037 +2707 54 
47 -7386 1032-1389 -0036 *2614 +53 
-48 "7479 1068-6362 -0035 +2521 52 
49 “7572 1106-5347 -0034 +2428 51 
8-50 8-7666 1145-8919 0-0033 1-2334 1-50 
Y-P/Z 
Z*/PQ fase Y 
1/Z Weight; Minimum Expected 
Range coefficient worn probit 
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Table of working probits 

















Maximum oe 
E ted : Weighting 
probit working Range coefficient 
Y probit 1/Z Z/PQ 
¥+Q/Z 
8-50 8-7666 1145-8919 0-0033 1-2334 1-50 
“51 *7759 1186-7675 -0032 +2241 -49 
+52 *7852 1229-2242 -0031 -2148 48 
-53 -7946 1273-3271 -0030 +2054 -47 
54 -8039 1319-1443 -0029 -1961 46 
8-55 8-8133 1366-7467 0-0028 1-1867 1-45 
-56 +8226 1416-2085 -0027 +1774 “44 
+57 +8320 1467-6071 -0026 -1680 -43 
-58 *8413 1521-0232 -0025 +1587 -42 
-59 *8507 1576-5411 +0024 +1493 41 
8-60 8-8600 1634-2488 0-0024 1-1400 1-40 
-61 +8694 1694-2383 -0023 +1306 +39 
*62 *8788 1756-6055 -0022 *1212 38 
-63 -8881 1821-4507 -0021 -1119 +37 
64 *8975 1888-8785 -0021 -1025 +36 
8-65 8-9069 1958-9983 0-0020 1-0931 1-35 
66 -9162 2031-9243 -0019 -0838 +34 
67 *9256 2107-7758 -0019 -0744 +33 
-68 -9350 2186-6775 -0018 -0650 +32 
-69 +9444 2268-7596 -0017 -0556 31 
8-70 8-9538 2354-1583 0-0017 1-0462 1-30 
“71 -9632 2443-0158 -0016 -0368 29 
‘72 -9726 2535-4807 -0016 -0274 +28 
‘73 -9820 2631-7085 -0015 -0180 *27 
“74 -9914 2731-8615 -0015 -0086 +26 
8-75 9-0008 2836-1096 0-0014 0-9992 1-25 
-76 -0102 2944-6302 “0014 -9898 24 
77 -0196 3057-6091 -0013 -9804 *23 
-78 -0290 3175-2401 -0013 -9710 +22 
‘79 -0384 3297-7264 -0012 -9616 21 
8-80 9-0478 3425-2801 0-0012 0-9522 1-20 
81 -0572 3558-1233 -0011 -9428 “19 
*82 -0667 3696-4883 -0011 -9333 18 
-83 -0761 3840-6179 -0011 +9239 “17 
-84 -0855 3990-7662 -0010 *9145 16 
8-85 9-0949 4147-1994 0-0010 0-9051 1-15 
-86 -1044 4310-1955 -0010 -8956 “14 
-87 -1138 4480-0457 -0009 -8862 “13 
-88 +1232 4657-0549 -0009 -8768 12 
89 +1327 4841-5419 -0009 -8673 “11 
8-90 9-1421 5033-8407 0-0008 0-8579 1-10 
‘91 -1516 5234-3007 -0008 -8484 09 
*92 +1610 5443-2878 -0008 -8390 -08 
-93 -1704 5661-1851 -0007 +8296 -07 
94 +1799 5888-3938 -0007 *8201 -06 
8-95 | 9-1894 6125-3338 0-0007 0-8106 1-05 
9% | +1988 6372-4452 -0007 “8012 04 
97 | = +2083 6630-1886 -0006 -7917 03 
a *2177 6899-0468 -0006 *7823 ‘02 
-99 | +2272 7179-5252 -0006 -7728 ‘01 
9-00 9-2367 7472-1536 0-0006 0-7633 1-00 
. Y-P/Z x 
1/Z wid | fl Minimum Expected 
Range aiden working probit 
probit 
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The proportion killed is p = 119/281 = 0-4235. 
For Y = 4-61, the Table shows the minimum working probit and range as 
Yuin, = 3°6680, 


and 1/Z = 2-7047. 
Hence the working probit is Y = 3-6680 + 2-7047p 
i = 4-8134. 
Alternatively, if survivors instead of deaths have been recorded, calculation may proceed 
| from Yinax, = 6°3727, 
giving y = 6-3727 — 2-7047 x 0-5765 
: = 4-8134. 
The Table shows w = 0-6023, 


so that the weight for the observation is 
nw = 281 x 0-6023 
= 169-2. 
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MISCELLANEA 


A note on the x? smooth test 
By H. L. SEAL 


The now-classical test of goodness of fit of a theoretical frequency distribution to a set of observations 
n 

consists of the calculation of & (dm,)*/m,; (where m, is the expectation of the jth group of observations 
j=1 


j= 
and dm, the deviation of the actual number of observations in this group from its expectation) and 
reference to tables of x? with n — 1 degrees of yee This is under the assumption that the only restraint 


on the theoretical frequency curve is that 2 oe = = 0. In her recent contribution to this Journal, 


F. N. David (1947) shows by a geometrical ec that, under these circumstances, a test of the signi- 
ficance of sequences of like signs in 6m,(j = 1, 2, ...,) is, for practical purposes, stochastically independent 
of the x?-test. The restriction of the arguments to cover only the case of a single linear restraint is, 
however, unnecessary. 

It is possible, in this connexion, to state a useful general theorem: If x,(j = 1,2,...,n) are n random 
variables normally distributed about zero mean with = variance, these variables being connected by means 


of k linear relations, the probability distribution of q? = s x} remains unaltered if we select only those samples 
j=1 


in which the signs of x; follow a specified pattern. 
The proof is immediate since 





1 
e-ta’gn—k-1 F(w,, tégy ..-9 Un—a)> 


PAXy, Lg, ---y Ly} = 2—-W-AT [h(n — DB) 


n 
where z;= qu; #=1,2,...,n, Lw=l 
j=1 
and the u,(j = 1, 2,...,2—1) are connected by k further relations (cp. Hald & Rasch, 1943). Thus, changes 
in the signs of the z’s are reflected by changes only in the signs of the u’s, the joint distribution of which 
is independent of that of q. 

Naturally this theorem does not apply directly to the case considered by David since the x?-test is 
there only an approximation to a set of terms of a multinomial expansion. It is, moreover, easily seen 
that if the squares of n independent random variables, with the same arbitrary skew distribution law, are 
added, the probability distribution of the resulting sum will necessarily depend on the signs of these 
variables. However, the practical use of the x*-test as an approximation implies ‘near independence’ of 
the test for sequences of signs even when k parameters (instead of one) have been fitted and have reduced 
the degrees of freedom to n—k. 

A further point may be made. David’s method of combining the y?-test of goodness of fit with the 
sequence test envisages a frequency distribution m,(j = 1, 2,...,) where n is relatively small: in fact 
her tables for the application of the combined test are calculated for n = 5(1) 14. There is, however, 
a closely analogous case where n may assume a value between about 30 and 75, namely in testing the 
efficacy of the graduation of a mortality table. The writer (1943) suggested that in this case a good test 
would consist of the application of a x?-test of goodness of fit with n — k degrees of freedom and a sequence 
test in the form of a 2 x 2 contingency table and associated x? value, as indicated by Stevens (1939) 
himself when he suggested this latter test. In answer to an inquiry, the writer said he was ‘not sure of 
the complete independence of the tests’ but in view of the preceding it may be said that the second x? 
(one degree of freedom) is very nearly independent of the x? value in the main test, so that the two can 
be conveniently combined by addition into one value with n—k+1 degrees of freedom and a useful 
probability judgement of ‘smooth fit’ obtained.: 
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Rank correlation and product-moment correlation 
By P. A. P. MORAN, Institute of Statistics, Oxford University 


The sampling distribution of Spearman’s coefficient of rank correlation, p,, has been thoroughly studied 
in the case where every permutation of the ranks of one variate relative to another is equiprobable and 
more recently Héffding (1948) has shown that it tends to normality for large samples whatever the 
p*rent population. This note deals with the distribution, when the parent is normal, for any size of 
sample. 

Let (2, Y;) --- (%n» Yn) be asample of n pairs of values from a bivariate normal population with correlation 
coefficient p. To obtain p, we replace 2, ...,2, and y;,...,y, by their respective ranks and calculate the 
product moment correlation coefficient of the ranks as if they were variate values. We have then to 
discuss the distribution of p, when p is known. i 

Consider first the expected value of p,. Let p(x;,), p(y;) be the ranks of xz, and y,;. Write 

H(t)=0 for t<0 
=] t>0. 
n 
Then p(x) —1 = 2 A(x,—3;). (1) 
j=1 
p; will be the correlation coefficient of the numbers {p(x;)— 1} and {p(y;)— 1}. If we had defined H(¢) in 


such a way that H(0) = 1 we would have obtained p(z;) on the left-hand side of equation (1) but this 
greatly complicates later calculations. Now write 


n 
S = 2 (p(x;) — i) (p(ys) — 1). 


n 
It is easy to verify that = {p(x,) —1} = 4n(n—-1), 
i=1 
n 
and (le) — I = den(n*—1), 
i= 
where is the mean of the ranks. 
_8—4n(n-1) 
It follows that Pp = Ann?) ” 


and to find H(p,) it is enough to find E(s). Now 


n n n 
s= 2X 2 & HA(«x,—2,) H(ys:—y)- 
it=1j=l1k=1 

The terms in this expansion for which i = j or ¢ = k are zero. There remain only two cases to consider. 

Case I. i,j,k all distinct. Then 2;—2;, y;— y, are distributed in « bivariate normal distribution with 
correlation coefficient equal to 4p. E{H(x;—x;) H(y;—y,)} will therefore be the chance that both these 
quantities are positive, that is, the integral of the probability density over the positive quadrant. This is 
known (Sheppard, 1898) to be equal to ${1 — 2-1 cos~! $p}. There are clearly n(n — 1) (m— 2) such terms. 

Case II. i+j = k. Then x; —2; and y,;— y; have a correlation coefficient p and the expectation of each 
term is }{1—72-cos—'p}. The number of such terms is n(n—1). 

It follows that 


E(s) = 4n(n— 1) (n— 2) (1—2-* cos $p),+ 4n(n— 1) (1—7-' cos p), 
12 








and so E(p,) = nn? 1) {4n(n — 1) (n— 2) (1—7~—* cos $p) 
+ 4n(n— 1) (1-2 cos p) — n(n — 1) 
6(n—-2. | ve 
= sani wt 7}. (2) 


For p = 0,1 this equals zero or unity as we would expect. Equation (2) may be compared with 
K. Pearson’s approximate formula (1907) for turning rank correlation coefficients into product moment 
correlation coefficients, which he derived by using the’correlation of grades. This is 


6. 
P. = = sin™ tp. 
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Equation (2) tends to this as n increases, showirg that p, is not only a biased estimator of p, but also 
an inconsistent one. This, of course, does not prevent the use of p, in estimating p. 

The table which follows is a table of E(p.) as given by (2) for n = 5, 10, 20 and oo, p = 0(0-1) 0-9. The 
lower part of the table, for comparisoa, shows the expected values of r, the sample product-. »ment 
correlation coefficient, for the same values. These were taken from the tables in Soper, etc. (1917). 
Interpolation for H(p,) is tincar in (n+ 1)! and nearly linear in n-. 





p= 0-1 0-2 0-3 0-4 0-5 0-6 0-7 0-8 0-9 





E(p,)n=5 0-0797 | 0-1597 | 0-2408 | 0-3233 | 0-4080 | 0-4958 | 0-5883 | 0-6881 | 0-8022 
n= 10 | 0-0869 | 0-1741 | 0-2620 | 0-3511 | 0-4419 | 0-5349 | 0-6313 | 0-7326 | 0-8428 
n= 20 | 0-0910 | 0-1823 | 0-2742 | 0-3671 | 0-4613 | 0-5573 | 0-6559 | 0-7580 | 0-8659 
n=co | 0-0955 | 0-1913 | 0-2876 | 0-3849 | 0-4826 | 0-5819 | 0-6829 | 0-7859 | 0-8915 


E(r)n=5 0-0884 | 01773 | 0-2671 | 0-3584 | 0-4517 | 0-5480 | 0-6482 | 0-7541 | 0-8687 
n= 10 | 0-0946 | 0-1896 | 0-2850 | 0-3813 | 0-4787 | 0-5776 | 0-6785 | 0-7819 | 0-8887 
n = 20 | 0-0974 | 0-1950 | 0-2928 | 0-3911 | 0-4900 | 0-5896 | 0-6902 | 0-7919 | 0-8951 






































Before considering the calculation of var(p,), which we can find from var(s) and so from E(s*), we 
must consider the problem of evaluating the total probability in the positive part of a quadrivariate 
normal distribution. 

Suppose that 2z,,22,73,2, are distributed in a quadrivariate normal distribution with correlation 
matrix 

1 Piz Pis Pu 


1 Res Pea 
1 Ps 
1 
We write Piz Pis Pius 
> Pes Po | = pr{x,>0,27,>0,273>0,2,> 0}. 
Psa 


This will be independent of the variances of the x’s which we suppose all equal to unity. Then the 
characteristic function of the distribution is 


P(ty, ty, ty, ty) = exp {— Hi — 4-H — 4 — prot t, — Prgty ts — Prats ty — Pastels — Poataty —Psatsta}, 





and we then have ts Pon ie 
T Pes Pe 
Psa 
1 cs) o fa re) cs) co fe) 4 
= ran | i) | diddy, | { f | P(ty, te, ty, ts) exp {—i Lt, x,} dt, dt,dt,dt,. 
lémJoJoJoJo et ee ae ae "1 
Now P(tys ty, by, ta) 
= (— L)itmtntetate of, pl piPasPSaPo 
= exp 22a Zz > >> > 
: {- PL } = 2,2 0 p=0g=0r=0 liminipt@ir! 


x gttegtetegmsteteestete, 


and we can therefore write 


Pia Pis Pra * 
T Pes Pea = 2 2, = = = = AimnparPi2PisPi4 P23 PiaP ou 
Psa 
where Baits = ( a TterereterG, oon Gis v0 Gn+o+0 Garate 





liminip!qir! : 
1 


ioe] 2 
and G,= an} az | exp { — 4t? —itx} dt. 
- —2 





. the 
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1 . 1 d\" f° 
Now oa | ___ftexp(—4—ite)ae = (ZY exp(— ae ita) 


as as ib @ es —32* 
=a le) (Qmi° 


From this it follows that for s = 0, G, = 4. Consider s>0. Then 


f) 1 d s 
_ wey RS —ja* 
a= f° aan Gal ae 


= <8 ehh @ ig ja" 
~ (=a*(2mi [ (a) . i 


=0 when s is even 
_ (2m)! 
~ 4(2m)t 2m! 


Our final result is therefore 


when s is odd and equal to 2m+1, where m = 0, 1, 2,.... 





Ps Pix Pu SS FF FF CHM wen isos mre Gaseee 
T Pos Pes 1=0 m=0 n+ 0 p=0q=0r=0 liminipigir! 
Ps a a PisPisPisP3sPhePo 
= 16+ aq P12 + Pas + Pia t Pos + Poa t Psa) 
1 
+in (P12P sa + PisP2a + PraPos) +--+» (3) 
but not all the terms are positive. For example, the coefficient of 
: 1 
PiPisPull =m=n=1,p=q=r=0) is “a 


Expressions similar to the above have also been given by M. G. Kendall (1941, 1945) and have also 
been given in the lecture courses of Prof. A. C. Aitken as is stated in Kendall (1941). Kendall’s version 
of the formula for four variables needs to be interpreted in the light of an earlier comment that the 
leading term is conventionally determined and in any case omits a power of —1. 

We now consider the problem of finding var (p,). Since 


var (p,) = 2 Var (8) 


44 
n*(n*— 1) 
it will be sufficient to find var(s) = E(s*)—[£(s)}*. Now 

n n n n n n 
v= 22 zt SZ & A(x,—2;)H(y;—yx) H(xy—X_) H(yy—y)- (4) 
i=1j=l1k=1p=l1q=I1r=1 
Terms in this expansion for which i = j,i = k, p = q or p =r are zero. If we write 
X,=2%,-%;, X,=y¥i-yx X3=%y—-F%ye Xy=Y_—-Yn 
the quantities X,, X,, X;, X, will be distributed in a quadrivariate normal distribution and the chance 
that they are all positive will be 
$p(1 + d5x) (Sip — Sig — 95 yp + 55) $0( 8:5 — Fig — 85 + Sin) 
T $P(Sin—Sig—Sevt Fea) HOin—Sie—Sint+ Sie) > (5) 
$o(1+8,,) 
where 6,; is the Kronecker 6 equal to unity if i = 7 and zero otherwise. Using (3) we can now evaluate 
E{H(x,;—2«;) H(y;— yx) H(%y—%_) H(¥y— Yr)} = pr{X,>0, X_>0, X,>0, X,> 0}, 


and we must calculate (5), using (3), for each type of set of suffixes in the terms of (4). The number of 
times each such type of term occurs in (4) will be n(n — 1) ... (m—s+1), where s is the number of distinct 
suffixes. From a theoretical point of view this solves the problem but in practice, since there are a fairly 
large number of different terms which arise from the various ways of identifying suffixes in (4), it is 
probably only barely possible to calculate var (p,) for any given value of p. It is certainly not practical 
as a routine. 
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The above investigation may be compared with the similar investigations on the sampling distribution 
of Kendall’s 7 (Greiner, 1909; Esscher, 1924; Kendall, 1948) and the relative simplicity of the latter, 


especially in the formulae for the variance, brings out once again the superiority of 7 as a measure of 
rank correlation. 
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Tests of significance in the variate difference method 
By N. L. JOHNSON 


1. The variate difference method has been discussed by many writers, and in particular by Yule (1921), 
Anderson (1923, 1926, 1927) and Tintner (1940). It is a method of isolating the random part of certain 
types of time series and is briefly described in § 2 below. 


2. Let u,, ug, ..., U, be successive observations at equal intervals of time, forming a time series. Suppose 
that it is reasonable to assume that uy = fete (1) 
— > 


where (i) f, is a ‘smooth trend’ such that for some integer K (and hence for all larger integers) 
Af += 0; 
(ii) z, is a ‘random residual’ with expected value zero and standard deviation o, independent of ¢; 
(ili) 21,2 ,.--,Z, are mutually independent. 
Under these conditions, if the series (u,) be differenced K times, the f, terms will be eliminated and, 
in fact, AFu, = A¥z,. (2) 
Furthermore A¥+1y, = AX+1z,, AK+2y, = AX +2z, and so on. 
Since these relations hold, we have, for k>K, 


E(A*u,) = 0, (3-1) 

E[{A*u,}*] = **C,0%. (3-2) 
n—k 

Thus, if k>K S, = [(n—k)*C,} X {Atu,}? (4) 
t=1 


is an unbiased estimate of o*. 
If Af, = 0, i.e. if the original series is random 


n 
Sp = (n—1)2 D (uy — 7)? (5) 
t=1 
is an unbiased estimate of o*. 


The sequence of statistics Sp, S,,.S,... is computed from the observed values w,, tg, ...,U%_3 S;, being 
defined by (4) for k>1 and by (5) for k = 0. This sequence may be used as an indicator of the order 
of difference at which the non-random elements are first eliminated. Generally the original series is not 
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random and so S, is usually considerably smaller than S,. As k increases the ratio S,,,/S,should approach 
unity. The value of k at and after which S,,,/S, stays sufficiently close to unity is taken as the order of 
difference necessary to eliminate the non-random terms f,. 

3. Inorder to test precisely whether the ratio S,,,/S,, is in fact ‘sufficiently close’ to unity it is necessary 
to assume a form of distribution for the z,’s. It is supposed that the assumption of a normal form of 
distribution for the z,’s will not give rise to serious efror. Even with this assumption it is very difficult 
to obtain exact significance levels for the ratio S,,,/S,, owing to the existence of correlations of various 
degrees of intensity between the differences involved. 

Tintner suggested a method of overcoming this drawback. He proposed that certain sets of the kth 
and (k+1)th differences should be selected in such a way that any selected difference of either order 
should be uncorrelated with any other selected difference of either order. The sets to be selected were of 


the type: (A*x,) r=t, t+(2k+3), t4+2(2k+3), ..., t+(j—1)(2k4+3); 

(A*4u,) s=t+k+1, ¢+k4+14+(2k+3), .... t+h4+1+4+(j7—1)(2k4+3). 
t may have any integral value from 1 to (2k+ 3) inclusive, each value giving rise to a different selection; 
j has the largest value possible. In any one selection none of the quantities A*u,, A*+4u, have a u, in 
common, and their independence is thereby assured. If the non-random elements have been removed 


by taking kth differences, then (A*u,),(A**+1u,) should be sequences of independent normal variables, 
each with expected value zero and with variances in the ratio 


#0, /+20,., = Hk+1)/(2k+ 1). 
Tintner suggests using as test criterion 
2 
2A") 2(2k+ 1) 


ge Sa) kel or .z= $log, F. (6) 
8 





Standard tables of F orz, entered with degrees of freedom j,7 would then provide exact significance limits 
for the suggested criteria. 


4. Although this method of selection gives a test which is exact, provided the assumptions upon which 
it is based are correct, it involves the sacrifice of a considerable proportion of the data available. Thus 
only about one out of each (2k+3) members of the two difference columns under comparison is used 
explicitly in the test criteria. This is necessary if the correlation between any two selected differences is 
to be zero. 

It is possible, however, to make use of somewhat more of the data available, still subjecting the results 
to a fairly simple exact test, analogous to that proposed by Tintner. Consider, in fact, the modified 
method of selection leading to the sequence of pairs of differences 

(Atu,, A*+u,) r=t, t+k+2, #4+2(k42)..., t4+(j’—1)(k+2). (7) 
Here ¢ may be any integer from 1 to (k+ 2) inclusive, and 7’ has its largest possible value. 

If non-random elements have been eliminated in the kth differences then 

(i) the correlation between corresponding differences A*u, and A*t+4u, is —[}(2k+ 1)/(k+ 1)}'; 

(ii) any difference of one order is correlated only with the corresponding difference of the other order; 

(iii) the expected values and ratio of variances of the sequences (A*u,), (A**+1u,) are the same as in 
Tintner’s method. 

An exact test based on the selection (7) would utilize about twice as many differences as would Tintner’s 
test for the same time series. For example, we have the following comparison between Tintner’s method 
of selection and method (7) in the special case ¢ = 1,k = 2. 


Tintner’s Method Present Method (7) 
A*u, ASu, A*u, AS’u, 
A®u, = ug— 2ug+u, Au, = uz — 3ug+ 3u;— uy A®u, = us—2ug+u, | A®u, = uy—3us+ 3u,—Uu, 
A®ug = Uyo— 2g + Ug | Abu, = Uy4— 343+ 3u,.—U,, | A2u, = uy—Qugtu, | A®u; = ug—3u,+3u,—U, 
etc. etc. etc. ete. 
Variance 60% 200? ; 6c? 2002 
Correlation 0 — «/(5/6) 





The gain in efficient use of the data would not, howéver, be as great as this would suggest, since the 
correlation is high between the differences already in Tintner’s selection and the additional differences 
introduced in (7). Nevertheless, a certain amount of extra information would be used in a test based 
on (7). Such an exact test, analogous to Tintner’s test, is derived in § 5. 
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5. In the case of Tintner’s method of selection, the hypothesis which should be tested is that the 
expected values of each of the differences is zero. The ratio of the variances of the differences in the two 
sequences is known. The alternative hypotheses specify non-zero values of the expected values, the ratio 
of the variances remaining unchanged. It is not necessary that these non-zero expected values be 
constant for either of the sequences of differences involved. Tintner’s criterion is, however, appropriate 
to the case where the alternative hypotheses specify different values for the ratio of the variances, the 
expected values remaining at zero (i.e. the hypothesis tested is that the variances are in a certain ratio, 
it being assumed that the expected values are zero). This system of hypotheses seems to be a reasonable 
approximation to the situation, as may be appreciated by regarding the differences A*f,, A**1/,, as 
random variables. 

A similar approach in the case of selection (7) leads to the conclusion that the hypothesis to be tested 
may be stated as follows: ‘The variances of the two sequences of differences are in a certain ratio, and the 
correlation between corresponding differences has a certain value. It is assumed that all expected values 
are zero.’ The alternative hypotheses specify other values for the ratio of the variances and the 
correlation, all expected values being supposed to remain at zero. 

A test appropriate to this situation may be obtained by a slight modification of a result due to Hsu 
(1940), who used Neyman and Pearson’s likelihood ratio method to derive a number of tests of hypotheses 
regarding two normally correlated variables. The hypothesis to be tested is, in fact, nearly the same as 
Hsu’s hypothesis H, and the appropriate test criterion is similar to his criterion L,. This similarity is not, 
however, apparent when the special symbols and values of the present problem are inserted, giving 
a test criterion we FT, Teas a rT? i (3) 

(26 +1)(Tr,2+ +1) (2k41)7 Thar eet Teel’ 
‘ where T, ¢ = LA?u,A%,. 





Tr 
LI must lie between 0 and 1. Low values of L are regarded as significant of departure from the hypothesis 
tested, indicating that the ‘non-random’ terms have ‘not been eliminated in the kth differences. If 
non-random variations are in fact absent from the kth differences, the probability density function of 
“as AL) = 9-1) L#'-)  (0<L<)). (9) 
It will be recalled that 7’ is the number of differences in each of the sequences (A*u,), (A*+4u,). From (9) 


it follows that D,, the significance limit corresponding to a probability « of rejecting the hypothesis 
when it is valid, satisfies the equation Liv») = a, 


logig Ly = (210g19%)/(7’— 1). (10) 
If log,, L be taken as test criterion, the significance limits may be calculated very easily by means of 
(10). We note that the 5 % limit for log,, Z is —2-6/(j’—1), and the 1 % limit is —4-0/(j’—1). 

6. We shall now apply selection (7) to the series of American wheat-flour prices for the years 1890- 
1937, which is analysed by Tintner. There are forty-eight observations in this series. Taking ¢ = 1, and 
comparing the first and second order differences (i.e. k = 1) we have the sequences 
Au,, Aw, Au, 


At,, Ateeg, Atte, ...5 ABtegg; 


i.e. 


cop Eitlggs 


so that 7’ = 16. (It may be noted that the sequences of differences in Tintner’s selection 1-A each contain 
9 members.) The sums of squares and products are 


Ty, = 31-259830, 7, = —23-842300, T,,. = 29-137173, 
L = 0:3889, 
logi) L = —0-4102. 


Forj’ = 16, the 1 % limit for log,, Z is — 0-27 and the 5 % limit is — 0-17. The calculated value of log,, 
is less than the 1 % limit, and it seems unlikely that the non-random terms have been eliminated in the 
first differences. 

Now taking k = 2 (and ¢ = 1 as before) we have the sequences of differences 


A%u,, Ass, Atte, ..-, Ags;  A®e,, Aas, Ag, 


whence 


and 


ory A®tgs3 
so that in this case 7’ = 12. The sums of squares and products are 


T's. = 12-030127; T,,, =—10-330714; 7, = 53-809942 
L = 0-3396, 
logis L = —0-4690. 


whence 


and 


ntain 


B19 L 
in the 
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For j’ = 12, the 1 % limit for log,, L is — 0-36 and the 5 % limit‘is — 0-24. Again it seems unlikely that 
non-random terms have been eliminated. 

Comparing third and fourth order differences (k = 3) we have, using the selection corresponding to 
t=1 Ts,3 = 102-200898, 7; , = —188-615311, 7, , = 358-329689, 
giving L = 0-5862 and log,, L = —0-2320. The appropriate 1 % limit (j’ = 9) is — 0-50 and the 5 % limit 
is —0-33. This test supports the hypothesis that non-random terms have been eliminated in the third 
order differences. Before a final decision is reached, of course, further tests would be made, using other 
possible values of ¢, and dealing with higher orders of differences. The above calculations should, however, 
be sufficient to make clear the mode of application of the method of selection (7) and its associated test 
of significance. 

7. It is not essential that the sequence of pairs of differences be chosen as in (7) above. Any sequence 
satisfying conditions (ii) and (iii) of § 4may be used, and acorresponding criterion, similar to (8), obtained 
by inserting the appropriate terms in the 7’, ,’s and using the correct value of the correlation coefficient 
between corresponding differences. The sequence 


(A¥tipya,A*u,) rat, t+k+2, t+2(k42), ..., t4+(j’—1)(k+2) 


is very similar to (7) and leads, in fact, to identically the same criterion. 


Other alternative methods of selection may aim at reducing the correlation between corresponding 
differences. For example, in the sequence 


(A*u,, A*#1u,,5)(p<k) r=t, t+k+2+p, t+2k+2+p), 
this correlation is 





k(k—1)...(k-—p+1) 2k+1\4 
—])Pti2ksug¢ (2kO, Ae+DC. & — (—])+1 
(-1) oeoealt™A0, 90,4) = (— tt ease ee 

Unfortunately the more the correlation is reduced the greater the proportion of data eliminated by this 
method of selection. 

A further possible method, possessing the advantage of symmetry, could be based on the comparison 
of kth and (k+2)th order differences, using the sequence 

(A*u,.,,A*+2u,) r=t, t+k+3, #+2(k+3),..., 

in which the correlation between corresponding differences is 


—[(2k + 1) (k+ 2)/(2k+ 3) (k+ 1}. 
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REVIEW 


The Advanced Theory of Statistics. Vol. m1, pp. 1-521. By M. G. Kenpatt, M.A. 
London: Griffin and Co., Ltd. 1946. Price: 50s. 


There is only a small measure of agreement among writers on the theory of statistics as to what should 
constitute an advanced course in the subject. There is no common view about either the nature of the 
problems which should be discussed or the methods by which they should be solved. Disagreement 
about the actual details of solutions of theoretical problems is, perhaps, only a passing phase and its 
importance may be exaggerated. The way in which the problems themselves are posed, however, 
reveals more fundamental cleavages of opinion which may not be so easily reconciled. 

An important element which renders difficult the formulation of theoretical problems is the uncertain 
relation existing between the theory and the practice of the application of statistical methods, as soon 
as we advance beyond the most elementary stages. In discussing this relation it is convenient to 
distinguish between the theoretician or, as he is now categorized, the mathematical statistician, on the 
one hand, and the practical statistician, using statistical methods in some particular field of inquiry, 
on the other. This distinction may have some validity if it is not pushed too hard. It is true that at 
one extreme there is a body of workers whose interest in the theory of statistics is primarily as a source 
of mathematical problems. And, at the other extreme, there are experimentalists who apply statistical 
methods by rule of thumb, without much concern for the reasoning which is needed to justify them. 
But, although the modern tendencies in the organization of all the sciences may be such as to force 
workers into extreme positions and label them accordingly, it must be recognized that, in statistics, 
the theoretical and the practical investigator are still, fortunately, often one and the same person. 

This fact undoubtedly makes for a closer integration of theoretical developments with practical 
usages, but not, perhaps, to the extent that one might imagine. It is in the nature of theoretical work— 
almost in its definition—that, whoever may be responsible for it, it should assert the right to an 
independent existence of its own and refuse to be tied down too closely by considerations of its ultimate 
usefulness. Even were statistical theory to be cultivated exclusively by writers who at the same time 
were outstandingly competent in dealing with the more commonplace, everyday, statistical investiga- 
tions, it would still not escape the tendency to become a purely abstract discipline. The time spent on 
it would still have to be justified by secondary considerations, such as its aesthetic appeal, educational 
value and the like, as well as by its ability to provide novel statistical procedures of practical value in 
the experimentai and social sciences. 

The tendency of statistical theory towards exclusive concern with abstract generalizations is helped, 
of course, by those mathematicians who are interested in nothing else. There is, however, as one might 
expect, a strong reaction against it from statisticians who still maintain a wider outlook. This reaction 
expresses itself, sometimes explosively, in the form of exasperated criticism of this or that piece of 
theoretical work on the grounds, either of its irrelevance, or worse, of the misleading impressions which 
it may give of the true objects of practical statistical investigations. The criticism is not always fair 
or well directed. Its authors are seldom immune from the failings, real or imaginary, which they castigate 
in others. But it is sufficient to show that statisticians as a body, however pleased they may be that 
their subject is gaining increased academic recognition, are yet unwilling to sanction the appearance 
of two separate subjects—pure and applied statistics—which can develop without much reference 
one to the other. Practical interests are still able to make themselves felt even in academic develop- 
ments. Further, since the practical interests of statisticians are so diverse, it is not surprising that 
a parallel difficulty is found in reaching agreement as to what is the proper subject-matter for the 
advanced theory of statistics. 

Mr M. G. Kendall, in the notable work of which the second volume is here under review, does not 
attempt to confine the subject within any very strict limits, nor to press upon the reader-any very 
decided views as to what should constitute its most important features. His method is rather to let 
the truth appear—if appear it can—by making an extensive and detailed survey of the whole range 
covered by modern contributions. 

The first four chapters of this second volume are concerned with the fundamental problem of 
estimating population parameters from sample values and of assigning limits to such parameters on 
a probability basis. This has in the past produced a most controversial literature, revolving round the 
question of the applicability or otherwise of the theory of inverse probability and of the various 
alternatives to this theory which have been proposed. Mr Kendall devotes most attention to the 
approach which does not make explicit use of the concept of inverse probability. Some readers might 
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consider that he should have given more space to the alternative position which is founded on Bayes’s 
Theorem and its corollaries. However, in a sense, Harold Jeffreys’s excellent restatement of this position 
in his Theory of Probability renders a lengthy description of it unnecessary, unless, indeed, Mr Kendall’s 
object had been to make a critical comparison and evaluation of the inverse and direct probability 
approaches. Mr Kendall is content to describe rather than to judge. One might, perhaps, criticize him 
in this section of the book for carrying his non-committal attitude too far in the face of the irreconcilable 
viewpoints which emerge from the discussion. He could, possibly, have pressed his own ideas upon us 
more strongly in certain passages, without departing from the high standard of fairness which he 
maintains throughout in representing the ideas of his statistical colleagues. 

The problem of scientific inference discussed in these first four chapters, although a fertile source of 
argument, is, strangely enough, one which, in whatever way it is settled, does not appear to influence 
much the actual way in which scientific investigation is carried out in practice. The next five chapters 
are concerned with a miscellaneous range of questions, which, while not having the same attraction for 
the pure theorist, are more closely related to those statistical methods used most frequently in the 
everyday interpretation of experimental data. They include, for instance, some discussion of the theory 
of the analysis of variance and of the role which randomization plays in ensuring the applicability of 
this theory in practice. The attitude which oné adopts towards the theoretical questions discussed in 
this part of the book can affect quite directly the choice between the alternative experimental 
procedures which may be at one’s disposal in some specific inquiry. 

The succeeding two chapters revert to a more generalized treatment following the same lines as 
the earlier ones. They are again concerned with the fundamental problem of scientific inference, although 
now from the restricted angle of significance testing. They furnish another illustration of the author's 
remarkable ability to reproduce the spirit as well as the substance of the original contributions covered 
by his survey. They again suffer, perhaps, from some lack of critical evaluation on the author’s own part. 

The next chapter deals with multivariate analysis, including discriminant functions. From the 
theoretical standpoint this is a straightforward development from the univariate and bivariate cases. 
Some new problems are raised, but much is simply generalization. Of the possible applications of these 
recent developments it is difficult to speak confidently. It is clear that in many fields multivariate 
analysis of the type here described can only proceed on the basis of many dubious assumptions as to 
the nature of possible connexions between the variates. Moreover, simple interpretation of the results 
of a multivariate analysis in terms which convey much to the layman is difficult. On the other hand, 
in certain cases where a very large number of variates are measured (e.g. in intelligence testing) some 
logical way of dealing with the results is needed, and one may in some instances be sure enough of one’s 
assumptions to exploit this recent theoretical work. 

The two final chapters deal with Time Series, a subject perhaps most studied by economists, but not 
one which has borne much fruit. Trade cycles have been sufficiently talked about, but there has been 
little analysis of data demonstrating their existence in an unequivocal fashion. Mr Kendall is the 
foremost representative of a school of thought which holds that the search for regular periodicities in 
economic data has been largely a waste of time, and that much more is to be hoped for by considering 
so-called autoregressive schemes, which allow for irregularities in the lengths of periods—albeit 
irregularities governed by some simple law. It is too soon yet to say whether the new conceptions will 
be much more successful than the old, but whatever success is obtained will be largely due to 
Mr Kendall’s own efforts to clarify the subject. 

Looking back after reading through the two volumes of Mr Kendall’s ambitious enterprise, one is 
forced to the realization that here we have one of the most remarkable compilations that has ever 
been attempted by a single writer in any branch of science. If several writers had banded together to 
produce it one would still be impressed by the wide range of topics and viewpoints which it embraces. 
One might almost be pardoned, indeed, for thinking that ‘M. G. Kendall’ was a pseudonym standing 
for the collaboration of several persons. This wouid, at all events, be a pleasant theory to explain 
the many excellences of the work, particularly its freedom from personal animosities and the generosity 
of its references to the contributions of so many different writers. It would also explain the somewhat 
loose-knit nature of the work judged as a whole. Occasionally one feels the lack of a sufficiently strong 
common thread running through it and holding it together; such as one would perhaps obtain if the 
author were inclined to be more trenchant in his criticisms of what other people write and more 
self-assertive in putting forward his own contributions. But in reply to all possible criticisms, Mr Kendall 
has the final word, when, in his concluding section, he says: ‘Much remains to be done; and this book 
will have served its purpose if the reader is left with the desire to do some of it himself.’ Few authors 
could by implication have exposed so clearly just what it is that remains to be done. 


B.L.W. 
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